Skip to main content

14 posts tagged with "hello"

View All Tags

· 2 min read

Creating a Heatmap in QGIS from CSV Data

Heatmaps are a powerful visualization technique that allow you to represent the intensity of data using color gradients. In this tutorial, we'll walk through the steps to create a heatmap in QGIS using CSV data. We'll be using real estate price data from the UK government's Price Paid Data downloads as an example. You can download the data from here.

Step 1: Download and Filter Data

  1. Download the CSV Data: Download the Price Paid Data CSV file from the provided link.

  2. Filter for Bristol Postcodes: Since we're focusing on Bristol, let's filter out only the rows with Bristol postcodes using the grep command. Run the following command in your terminal:

    grep '^"[^"]*","[^"]*","[^"]*","BS[1-9] ' pp-complete.csv > pp-complete-bs.csv

Step 2: Geocode the Data

Geocode Using csv2geo:

Visit csv2geo.com to geocode the filtered CSV file. This will add latitude and longitude columns to your data. Step 3: Import Data into QGIS Open QGIS Project: Open QGIS and create a new project.

Add Geocoded CSV Layer:

To add the geocoded CSV data as a layer, follow these steps:

  • a. Click on the "Layer" menu.

  • b. Select "Add Layer" and then choose "Add Delimited Text Layer."

  • c. Browse and select the bristol-pp.csv file.

  • d. Specify the Longitude field for the X coordinate and the Latitude field for the Y coordinate.

Step 4: Create the Heatmap

Style as Heatmap:

Style the layer as a heatmap:

  • a. Right-click on the added CSV layer in the "Layers" panel.

  • b. Select "Properties" to open the layer properties dialog.

  • c. In the "Symbology" tab, select the dropdown menu next to "Single symbol" and choose "Heatmap."

  • d. Choose the Price field as the attribute for the heatmap.

  • e. Customize the color ramp to represent low to high prices.

  • f. Adjust the radius and other settings to fine-tune the heatmap appearance.

· 3 min read

Essay: Establishing a Secure AWS Server Environment for GIS Data Management

In the realm of Geographic Information Systems (GIS), efficient data management is of paramount importance. The process of setting up a secure AWS server environment for GIS data management involves a series of carefully orchestrated steps to ensure the optimal handling of spatial information while maintaining robust security measures. This essay delves into the comprehensive process outlined in the provided script, highlighting each step's significance and role in creating a seamless GIS data management environment.

The journey begins with a secure connection to an Amazon Web Services (AWS) server. The Secure Shell (SSH) protocol is utilized, allowing remote access to the server's command-line interface. An SSH key is employed to authenticate the connection, ensuring a robust layer of security.

With the connection established, the server is prepared by installing essential software components. The apt package manager is leveraged to update package information and install Docker and Certbot, fundamental tools for containerization and SSL certificate management, respectively.

A directory is established to serve as the storage location for PostgreSQL data. This is a foundational step, as proper data organization is essential for efficient data retrieval and analysis in GIS applications.

Relevant files are transferred from a local machine to the server using the scp (Secure Copy Protocol) command. This is an effective way to populate the server with necessary GIS data and resources. Importantly, the transfer is initiated from the local machine and not within the SSH session, ensuring efficient data movement.

The script encompasses the configuration of a data loader. This loader is customized by modifying parameters in the loader.config file, which controls how data is loaded into the GIS database. The loader uses an ogr2ogr command to append data from files to a PostgreSQL database, facilitating seamless data integration.

Domain Name System (DNS) configuration is crucial for making the server accessible via user-friendly domain names. Manual interaction with the domain name provider is required to associate the instance's IP address with a "www" A name record, ensuring a consistent and recognizable domain for users.

The server's security is bolstered by configuring AWS security groups. Port 443 (HTTPS) and port 80 (HTTP) are opened, allowing secure communication and web access to the server instance. This step underscores the importance of access control and network security in the GIS context.

The setup of an SSL certificate for secure communication is a critical aspect of the script. The Certbot tool is employed to obtain and install the certificate, enhancing the security of data transmission between the server and users. Automatic certificate renewal is established through a cron job, ensuring continuous protection.

Containerization is embraced using Docker, a technology that enables efficient deployment and management of applications. A Docker container is initiated to host a PostgreSQL database with the PostGIS extension. This allows the storage and retrieval of spatial data while maintaining isolation and resource efficiency.

The script guides the configuration of SSL certificates within the PostgreSQL container. A secure directory is created to store certificates, and scripts are developed to manage their updates and permissions. This robust approach ensures that data transfers within the GIS environment remain encrypted and secure.

Finally, the GIS setup is put to the test. Credentials are provided to initiate a connection to the PostgreSQL database using the PostGIS extension. This step confirms that the configuration is operational and that spatial data can be accessed and manipulated securely.

· 2 min read

Innovative Integration: Crafting Functional Architectural Concepts with Visible Systems

The primary aim of this design endeavor is to create a comprehensive and functional architectural concept that fulfills all the occupant's needs. My goal is to understand the inner workings of building systems and explore ways to redesign or integrate them innovatively for improved efficiency. The building's form should be an elegant expression of how I creatively organize these systems. I want these systems to be visible, showcasing the essence of their processes, constructed from materials that truly embody their character.

Amidst the plethora of available building technologies, I strive to synthesize the minimum necessary elements that perfectly align with the design objectives for each unique building. This synthesis results in harmonious systems that serve their specific purposes flawlessly.

The initial step in this process involved creating a web diagram, mapping out various ways to integrate different technologies to cater to the occupants' needs. From this web, I derived smaller interconnected groups, or flows, which represent the conceptual frameworks for potential designs. To give these flows a tangible 3D form, I calculated the relative sizes of their components, which often have unique scaling ratios influenced by their arrangement.

Although the exact 3D arrangement of components has not been defined yet, we can still proceed with rough rules of thumb to scale the parts relative to one another. With these parts scaled between 2D and 3D, we can start crafting 3D conceptual designs. These designs are then subject to aesthetic and ergonomic considerations before entering a feedback loop for detailed analytical predictions of their behavior. Alternatively, we can directly proceed to working models, experimenting with suitable materials to assess their structural and aesthetic properties.

· 2 min read

Harmony of Natural Building Materials: A Journey of Exploration and Inspiration

In architectural design, a nuanced understanding of materials can elevate a project from functional to sublime. This philosophy guided my quest to explore and celebrate natural building materials like stone, wood, and mud. The goal was to resonate with each material's inherent qualities, and this undertaking became a profound journey of exploration and inspiration.

I began by contemplating the landscape where these materials are naturally abundant. In a cross-sectional view, stone is the essence of the subterranean, water-rich world, whereas wood represents the surface and the elevated, air-filled spaces. This exploration was not purely conceptual; it led me to create lightweight hazel structures that capture the ethereal aspects of wood and air, giving me a deeper appreciation for these elements. This experience piqued my curiosity about the stone's realm, prompting an ambitious excavation into a hillside. Though the endeavor was challenging and fell short of discovering any vast caverns, it was an adventure that added texture to my understanding of natural materials.

When structural concerns demanded the addition of concrete load-bearing walls in the tunnel, I felt we lost some of the raw, rustic aesthetics I initially envisioned. Despite this, the process was invaluable for understanding the limits and possibilities of natural materials.

Between the layers of stone and wood in my design, I imagined a thin layer of mud, a material that, though less explored, plays a pivotal role in the ecosystem. Its potential as a building material is intriguing and deserves further study, which I touch upon in the design section of my project.

In translating these insights into a functional design, I envisioned the wood layer as the ideal setting for sleeping quarters, offering a dry, warm loft space. The middle layer, the ground floor, is designed for the kitchen, toilet, and other functional spaces. Beneath it all, I left room for a subterranean space crafted from stone, its purpose still open to exploration.

This design journey has been more than an architectural project; it has been a holistic experience that deepened my relationship with the natural world. By harmoniously integrating these elements, I believe we can create buildings that are not just structures but soulful habitats.

· One min read

Optimized Design for Modern Motor Caravans: Blending Comfort and Function

Our mission in designing for small spaces goes beyond mere functionality; we aim to enhance the overall well-being of users. To achieve this, we've developed a space that perfectly marries comfort and practicality.

For structural integrity and insulation, we chose a layer of spray foam, shaped and refined with acrylic putty. This lightweight yet robust material ensures a cozy interior. Within this space, we created an efficient layout featuring a lengthwise single bed parallel to a desk, maximizing utility in a confined space. Additionally, we designed a path that allows free movement from the back of the caravan to the side door.

We've also included a fully equipped kitchen area with features like a water-saving faucet and a full-size fridge, catering to all cooking and storage needs. To control light and maintain privacy, the caravan is outfitted with double-layered blackout blinds and windows.

In summary, this space offers a balanced blend of comfort and functionality.

· 2 min read

INSPIRE Index Polygon House Prices - A Map of Average Sale Prices

In order to effectively analyze and visualize real estate data, it is important to first properly organize and process the data. To this end, our team combined three separate files containing price paid data into a single file and cleaned and filtered the data through a series of steps. These steps included the removal of quotes, the selection of only rows with "GL" followed by a number, the printing of certain columns, the addition of column names, and the deletion of rows with null values.

Once the data was cleaned and organized, we used the powerful tool ogr2ogr to convert a file with cadastral parcel information into a PostgreSQL file. We then changed the projection from OSGB to WGS84 and imported it into a database. In order to store the data in a structured manner, we started a psql session and created empty tables with certain columns in the database.

Next, we used the \copy command and SQL JOIN to combine the price and coordinates data based on their shared postcodes. We added a column for geometry data and used the latitude and longitude data to create points. We then calculated the average value for each of the duplicate polygons.

Finally, we used the powerful mapping software QGIS to export the table from the database and modified the layer properties for visual appeal. Through this process, we were able to effectively organize and analyze the real estate data, allowing us to extract valuable insights and gain a deeper understanding of the market.

During our analysis of real estate data, we encountered an issue with some of the postal codes not being properly associated with the intended polygons. This issue had the potential to significantly impact the accuracy and usefulness of our data.

To address this issue and improve the accuracy of our data, we decided to use a different set of polygons (parishes) with a lower resolution for the next project. We hoped that this approach would help to more accurately associate the postal codes with the intended polygons, resulting in a more reliable dataset.

· 4 min read

From Legacy to Innovation: A Journey in Architecture and Green Building

Throughout my architectural journey, I have been shaped by a multitude of experiences and inspirations that have led me to my chosen field of study. One of my greatest influences is my great grandfather, Sir Ove Arup, whose legacy profoundly impacted me. Witnessing the thin shell structures featured in the Arup Journal ignited my fascination for these architectural marvels. Building countless woven hazel frames further deepened my appreciation for unique structures, and I also explored traditional wooden boat building, captivated by the artistry of the craft.

Driven by the dream of building my own home on a piece of land in the garden, I drew inspiration from Lloyd Kahn's book, "Shelter." With friends, we embarked on the ambitious project of excavating a 14-meter long tunnel into the hillside, using stones sourced from the garden. The tunnel was reinforced with concrete to ensure stability, transforming our vision into a reality.

Recognizing the significance of understanding materials in architecture, I pursued hands-on experience. I attended a year-long course in fine joinery and followed it with a two-year apprenticeship in stone masonry. Additionally, I explored steel fabrication through a separate course, expanding my skills and knowledge.

My interest in aquaponics and domestic food production led me to extensive research on ecological system engineering, particularly the work of the New Alchemy Institute. Spirulina, a microalgae with exceptional nutritional benefits, intrigued me, and I explored ways to integrate photo bioreactors into buildings for sustainable food production.

Through creative exploration, I used SketchUp to document the construction of a pottery shed, and together with friends, we built an oak-framed building set into the hillside over the course of a year. My passion for boats led me to collaborate with a Canadian theatre company, contributing to ship repairs and creating scene-by-scene drawings for rigging procedures.

Seeking a deeper understanding of building technologies and structural elements, I established a personal studio. Utilizing color-coded material selection charts and exploring form-finding software, computational geometry, and fabric formed plaster, I created physical models of various structures. Additionally, I delved into technologies for energy efficiency and cost reduction in building materials.

Although I have enjoyed working as a part-time stonemason, I am eager to further expand my knowledge through a university education. My interest lies in understanding the functional technologies of buildings before exploring sociological and aesthetic considerations, ultimately shaping my future architectural practice.

Currently, I have two distinct streams of interest: thin shell structures, inspired by my great grandfather's work and my experiences with woven hazel branches, and a broader fascination with arranging elements efficiently to meet occupants' needs with minimal energy consumption, influenced by figures like Buckminster Fuller and principles of permaculture. I am in the process of organizing my research into meaningful forms, creating interconnected systems maps, and quantifying their relationships. My vision is to design buildings that embody these innovative approaches.

My passion lies in researching green building technologies, delving into the intricate physics of these systems. As I grasp the fundamental workings intuitively, I enjoy creating diagrams that visually represent the technology in an accessible manner. Using color-coded material property charts, I enhance my understanding and allow myself to explore this information imaginatively.

Crafting pictorial flow diagrams that document the fusion and evolution of design concepts brings me great joy. These diagrams become a web of interconnected ideas, from which intriguing concepts can be extracted and expanded into three-dimensional forms. This transformative process involves further refinements and adjustments to create refined designs.

The most captivating aspect of this functional design process is the emergence of peculiar aesthetics. Beyond mere functionality, the creations exude a unique and striking visual appeal. An example of such a conceptual autonomous building is depicted here, born from this very design process. This building features a magnificent piece of parabolically curved stainless steel with a dual purpose. Firstly, it collects rainwater, and secondly, it concentrates all rooftop solar irradiance into a single sheet of brilliant light. As this radiant light passes through the center of the building, it illuminates and energizes the interior rooms. Finally, it proceeds to the basement, where it gently heats a substantial volume of water and supports various waste treatment bioreactors.

· One min read

Parish House Prices - A Map of Average Sale Prices

In order to accurately assess the real estate market, our team utilized property sale data from the land registry and postal code data from the Ordnance Survey to determine the latitude and longitude coordinates of each house sale. This data was then imported into a PostGIS database, where an SQL query was run to calculate the average home price for each parish. To facilitate the visualization and analysis of this information, we utilized the powerful mapping software QGIS. By coloring the polygons representing each parish based on the average price, we were able to clearly and intuitively display the variations in the housing market across the region.

This process allowed us to gain a detailed and nuanced understanding of the real estate market, and to identify trends and patterns that would not have been immediately apparent without the use of spatial analysis. By combining the robust data management capabilities of PostGIS with the intuitive mapping capabilities of QGIS, we were able to effectively and efficiently analyze complex data sets and extract valuable insights.

· 3 min read

Advancing Solar Concentration with a Spherical Solar Concentrator

Solar energy, a promising renewable resource, holds immense potential to meet a significant portion of the world's energy demands. However, harnessing and concentrating solar energy efficiently remains a challenge in widespread adoption.

This paper introduces a groundbreaking solar concentrator that utilizes a spherical structure adorned with rotating mirrors to effectively concentrate solar energy. The sphere is covered with a multitude of small mirrors, each with the freedom to rotate in any direction. As sunlight approaches the sphere from various angles, the mirrors reflect the light towards the center of the sphere, leading to concentrated solar energy that can be utilized for electricity generation or water heating.

The solar concentrator comprises three key elements: a sphere, an array of small mirrors, and a robust support structure. The sphere's surface is adorned with numerous small mirrors, all capable of independent rotation. The support structure ensures the sphere remains in a fixed position while offering necessary stability.

The small mirrors can be crafted from reflective materials like glass, metal, or plastic, while the support structure must possess the strength to bear the sphere's weight and endure prolonged sun exposure.

The versatile solar concentrator can be harnessed for two primary purposes: electricity generation and water heating. In electricity generation, the concentrated solar energy heats a fluid (e.g., water or molten salt), which, in turn, powers a turbine to produce electricity. For water heating, the solar energy directly heats the water, providing a sustainable solution for various daily needs.

The innovation of employing a sphere with rotating mirrors endows the solar concentrator with numerous advantages. Firstly, the rotating mirrors efficiently capture sunlight from diverse angles, heightening its solar energy absorption. Secondly, these mirrors effectively concentrate the sunlight into a confined area, maximizing electricity generation or water heating efficiency. Lastly, the simplicity in manufacturing and installation renders it a cost-effective solution for solar energy applications.

The solar concentrator features:

  • A spherical structure
  • A set of small mirrors
  • A sturdy support structure

The small mirrors are positioned across the sphere, each with free rotation capability.

The support structure ensures the sphere's stability and resilience to sunlight-induced corrosion.

The solar concentrator can generate electricity.

The solar concentrator can heat water.

The revolutionary spherical solar concentrator presents an efficient approach to capture and concentrate solar energy. Its distinctive features, including the ability to reflect sunlight from various angles, concentrate energy effectively, and cost-effective production and implementation, position it as a promising option for solar energy applications.

· 2 min read

Efficient Network Hardware Asset Management at a Festival

This festival was a massive event with sprawling arenas and fields covering 3km. The deployment of the network infrastructure was a complex undertaking to ensure seamless connectivity across the site. To achieve this, network cabinets were strategically set up in each arena, interconnected with miles of fiber optic cables. These cabinets were further linked to multiple bonded ADSL connections, providing a robust and reliable internet connection.

To extend connectivity within each arena, smaller network switches were positioned within 100 meters of the cabinets. Areas beyond this range were connected using wireless point-to-point links, mounted on poles attached to the sides of tents or beamed across the arena from wireless sectors mounted on cherry pickers. At distant locations, wireless point-to-point receivers were attached to the sides of tents to capture these signals.

Besides the network infrastructure, a comprehensive CCTV system was crucial for ensuring attendee safety. To achieve this, each arena was equipped with at least one cherry picker, hosting a pan-tilt-zoom CCTV camera. Additional cameras were installed on scaffolding poles, gateway arches, and stage sides. WiFi was also provided in the crew and camping areas, while temporary offices were equipped with WiFi and VoIP phones for efficient internal and external communication.

To facilitate the deployment and management of the network, we employed various tools and resources. For instance, we utilized QGIS's 'Align Raster' tool to georeference a high-definition site map image, which was then uploaded to Mapbox to create a basic Leaflet.js web map. This web map utilized the host phone's geolocation to position markers, aiding in identifying the exact location of tents requiring connectivity. We also utilized the 'Map Marker' app on Android to rapidly locate and deploy network devices.

After the event, the map proved invaluable in locating and retrieving all equipment. This was especially helpful as the staff members responsible for investigating faults or retrieving hardware were often different from those who deployed them, making it challenging to locate devices without an updated map showing their precise locations and connections. By utilizing this map, we efficiently traced faults in the network and ensured that all equipment was accounted for. Overall, the deployment and management of the network at the Isle of Wight Festival was a successful and intricate endeavor, contributing to the smooth operation of the event.