I recently had a project requirement to export the contents of a delta table in Databricks to several formats, including shapefile and file geodatabase, with the output being placed in object storage mounted to DBFS. I set up the logic in a notebook, with the intent to use geopandas, which provides an easy wrapper around … Continue reading Exporting Data with GeoPandas in Databricks
Tag: programming
A Grudging Thanks to Tests
Mea culpa, mea culpa, mea maxima culpa Jimmy Buffet, "Fruitcakes," 1994 I hate writing tests. With the white-hot passion of a thousand suns. Tests are good and necessary for quality software. Automating tests is the core of any CI/CD pipeline worthy of the name. I am well-versed in the value of tests and testing. I … Continue reading A Grudging Thanks to Tests
Data Over Software
One of the first tasks I ever had in my then-new GIS career was doing AML development in ARC/INFO 6.x for a data production project. My code parsed DXF exported from AutoCAD R11 for DOS and then assigned attributes based on things like layer, color, line weight, feature type, and others. It also georeferenced the … Continue reading Data Over Software
Lately…
These are some of the things I've been up to lately, while the blog has been quiet: At work, I've continued delving into BigQuery. Our FME jobs are running like clockwork and I've been spending a lot of time writing queries and doing analysis for various stakeholders across the company. The next phase of the … Continue reading Lately…
Catching Up with Microsoft
Looking Ahead