Technical Lead - DAG
- Get link
- X
- Other Apps
* Deep understanding and implementation experience in designing and developing ETL processes
that populate star schemas using a variety of source data on data warehouse implementations
supporting a product on both cloud as well as on premise.
* Solid understanding of design patterns and implementation experience in data modeling in SQL,
NoSQL spanning OLTP to OLAP (dimensional analysis and fact design).
* Solid understanding of design patterns and implementation experience in data pipelines -
Streaming (real-time) and Batch processing.
* Design and develop SQL procedural logic, functions, data materialization and triggers to be used
* Hands-on with proactive and reactive performance tuning instance-level, database-level and
* Strong data analysis implementation experience - exploratory, time-series, data profiling etc.
* Will be responsible for success of the engagement working closely with the client stakeholders
* Primary contact for the client team on technical aspects
* Experience in the requirements gathering process and ability to design the business process
* Work with data providers to fill data gaps and/or to adjust source-system data structures to
facilitate analysis and integration with other company data.
* Basic understanding of scripting such as using Python.
* Good understanding and preferably experience in all data areas on Cloud platforms.
* Good working experience on data visualization and reporting.
* Good working experience with Data Governance - row-level security, role-based access strategy,
encryption and masking of data, passwordless authentication etc.
* Perform analysis on source data to determine the feasibility of using this data to solve business
* Good understanding and previous implementation experience in high availability and disaster
recovery implementation on premise.
* Write scripts for automated testing of data in the target facts and dimensions.
* Prepare and establish update process for technical artefacts such as data catalog, ER diagrams,
Non-Functional requirements, data flow diagrams etc.
* Experience in conducting and responding to database audits information during all phases of the
ETL process including code reviews and refactoring recommendations.
* Excellent troubleshooting skills.
* Whatever else asked for the good of the company goals and initiatives.
* Implementation experience on Google Cloud Platform - BigQuery, Composer and Cloud Data
- Get link
- X
- Other Apps
Comments
Post a Comment