POSITION SUMMARY STATEMENT:
The Principal Data Engineer role is responsible for data modelling, architecture, design, optimization, security and administration of Enterprise Data Platform, ETL/ELT tools and data engineering interfaces. The role will be responsible for building data interfaces focusing on data accuracy, completeness and availability. The role will analyze source and target systems design, architect, build and test solutions to make data available Business intelligence systems, websites mobile apps and other applications.
DETAILED RESPONSIBILITIES/DUTIES:
Level III
- Architect and build data systems such as datamarts, data warehouses, data lakes, OLAP and OLTP
- Architect, Design, Build, Test and Migrate ETL/ELT solutions and data interfaces.
- Create a fluid, end-to-end vision for data flowing through our ecosystem to enable seamless, near real-time/ right time workflow integration with both relational and non-relational data store for both on premise and cloud environments.
- Envision and Lead and own end-to-end architecture vision & roadmap for the data platform to support the data strategy
- Research and architect systems understanding the current market offerings with data movement such as Azure data factory, DBT etc.
- Ensure all non-functional aspects of the platform are addressed, including scalability, security, maintainability and supportability.
- Analyze data sources and architect target systems data and data flow architectures.
- Design and implement data tables, functions, views, procedures and routines to provide accurate and complete data to BI and data applications.
- Identify and implement opportunities for technical innovation that add value to the platform.
- Establish and embed data management and governance processes.
- Enhance performance in the Applications environment.
- Meet service level agreements for production support response and resolution.
- Research, Design and Develop technical solutions to a pre-defined requirement and develop components including extensions, views, customizations, modifications, reports, and workflows independently or as a part of a team.
- Follow documentation, software development methodology, version control and testing, and migration standards.
- Be a subject matter expert in data strategy for data systems.
- Develop and improve the current data architecture, emphasizing data security, data quality and timeliness, scalability, and extensibility.
- Provide technical guidance and mentoring to others in areas of expertise.
- Deploy and use various technologies and run pilots to design low latency data architectures at scale
- Collaborate with BI teams, business analysts, product managers, and application teams to provide data for BI, web, mobile applications
- Collaborate with business analysts, data scientists, product managers, and BI teams to develop, implement, and validate KPIs, statistical analyses, data profiling, prediction, forecasting, clustering.
- Develop a cooperative environment that fosters knowledge sharing.
Qualifications:
Skills:
- Experience in implementing ETL/ELT tools like Informatica, ADF, DBT etc
- Experience in implementing Snowflake cloud Data warehouse.
- Experience in Kafka/Apache Spark or any real time ingestion tools
- Experience in BI tools like Power BI, MicroStrategy, OBIEE etc
- Experience in end-to-end solution architecture for Data Management and Analytics
- Experience in providing Data Architecture
- Experience in Data Management platform management.
- Manage multiple priorities.
- Proficiency in working with scheduling tools.
- Proficiency in working with change management tools and processes include source control, versioning, defect tracking and release management.
- Ability to achieve results working independently with limited guidance
- Ability to gracefully manage multiple priorities, commitments, and projects in fast-paced dynamic environment.
- Ability to effectively manage multiple large-scale, competing, high priority projects simultaneously with varying deadline
- Deep understanding of data management methodologies and technologies
- Experience with change management tools and processes, including source code control, versioning, branching, defect tracking and release management
- Ability to identify system impact for small- and large-scale initiatives
- Ability to track and maintain budgets across multiple projects and deliverables with a focus on ROI
- Stay informed about new technology trends.
-
- Excellent written and verbal communication skills.
Expeience:
Level III
- 13+ years experience in working with data in a data mart, warehousing, OLAP and OLTP environment
- 13+ years experience working with ETL/ELT and data movement tools
- 5+ years in innovating and architecting data solutions
Education:
- Bachelor’s in information technology, computer science or related field
Principles & Related Competencies:
Ethical
- Complies with policies and procedures; Takes the high road and upholds our values; Maintains confidentiality; Acts with integrity, honesty and respect.
Leader
- Meets challenges head on to uphold quality standards, productivity goals, and values; Sets an example, building a culture of trust, transparency, and open communication; Is aligned with organizational direction
Collaborative
- Works cooperatively with others offers and accepts help; Freely shares information as appropriate; Open to and willing to provide feedback; Strong contributor to the team’s results; Celebrates the individual and the team; Ability to clearly communicate.
Looks Beyond Oneself
- (Team Player) Demonstrates humility and willingness to recognize and give credit to others; Works well alongside people of different backgrounds and ideas; Builds good relationships with others; Values Distributors and teammates.
Drives Innovation
- Add value through: Proposing ideas and creative solutions to employee, distributor and/or customer challenges; Listening to and respecting others ideas through collaborating and helping develop those suggestions; Driving ideas forward to implementation.
Delivers Change
- Delivers Change Through: Adapting to different working environments; Responding positively to change including new duties and ass
