The heart of data analytics processing is metadata. There have been multiple metastore related products in Google Cloud Platform (GCP), there has not yet been a product that gives the best of open source compatibility while having transparent first-party integration with GCPs suite of Data Analytics tools (BigQuery, Dataproc, Dataflow, etc). This is the mission of BigLake, to create the one unified managed catalog for all of GCP.
We are riding the wave of the latest advancements in data analytics, integrating with technologies like Apache Iceberg and Apache Delta. Our work impacts the user experience across the GCP data analytics landscape - we collaborate closely with partner teams like Dataplex and Dataproc.
In this role, you will have excellent learning and growth opportunities. You'll be a part of the experienced BigQuery team, where you'll be empowered to design, implement, launch and land large-scale, impactful projects with the necessary support and guidance, and a large pipeline of enterprise customers waiting to use your features. You will be instrumental in shaping the architecture and future of BigQuery's metadata management capabilities. Your role is focused around improving Federation support for BigLake, which includes support for major strategic partners such as Salesforce, open source standards such as the Iceberg Rest Catalog, and other major metastores such as Glue. You will also build an engineering team responsible for all data and metadata federation aspects and expand BigLake to other clouds, hyperscalers, and partners like SAP and Salesforce.Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.