Undertaking:
We’re in search of an information engineer emigrate our current ETL workflows to Google BigQuery. We wish to optimize our information dealing with processes to extend potency and scalability for any information aggregation duties. This position calls for any person with a deep figuring out and revel in with large question, information pipeline optimization and checking out.
We’re in search of an information engineer emigrate our current ETL workflows to Google BigQuery. We wish to optimize our information dealing with processes to extend potency and scalability for any information aggregation duties. This position calls for any person with a deep figuring out and revel in with large question, information pipeline optimization and checking out.
We’re within the means of comparing what cloud database to head with. Recently, we are the usage of postgres and TimescaleDB extension. We now have a customized incremental materialized view-like machine the place we now have a desk with uncooked supply information (flattened JSON object). We had prior queries written to create construct tables that constitute the overall model of the aggregated information. Lengthy tale brief, the problem is that the construct takes a long time and purposes un-useable.
Closing date is ready for two weeks.
This position is a PROJECT-BASED place and has possible for a full-time place.