Staff Data Engineer

Job Description:

Responsibilities

• Design, build and operate technical services to support critical business processes and high volume Data Lake environment.
• Develop and maintain service specifications based on the results of operational data and functional requirements
• Operational support a variety of data loading & data transformation methods using multiple tools and technologies.
• Manage metadata structures needed for building data pipeline and object lineage.
• Good working hands-on knowledge of AWS cloud technologies like EC2, EBS, Load balancers, Glue, Lamba, Cloud Formation etc.
• AWS Redshift hands-on experience
• Analyze the impact of changes to downstream data systems/products and recommend alternatives to minimize the impact.
• Good knowledge on Application, Data and AWS infrastructure security (e.g. Saviynt, Sail point, AWS Identity center, IAM etc.)
• Derive solutions and make recommendations from deep dive data analysis proactively.
• Design, build and maintain Operational metrics and KPI and rules.
• Perform operational data analysis for DVM(Daily Visual Management)
• Sound understanding and applying FLIGHT DECK (internal candidates) on a daily basis.

Qualification & Experience    

•  The ideal candidate should have experience in AWS Redshift and Python
• Required Qualifications:
• Bachelor's Degree in Computer Science or “STEM” Majors (Science, Technology, Engineering and Math) with 8+years experience.
• Preferred Qualifications
• Exposure to Extract, Transform & Load (ETL) tools like HVR or Talend or AWS Glue
• Exposure to industry standard data catalog, automated data discovery and data lineage tools (e.g. AWS Glue catalog, other Iceberg catalogs)
• Hands-on experience in programming languages like Java, Python or Scala
• Hands-on experience in writing SQL scripts for Oracle, MySQL, PostgreSQL or HiveQL
• Experience with Big Data / Hadoop / Spark / Hive / NoSQL database engines (i.e. Cassandra or HBase)
• Exposure to unstructured datasets and ability to handle XML, JSON file formats
• Conduct exploratory data analysis and generate visual summaries of data.
• Domain Expertise:
• Exposure to handling structured and semi-structured data from business processes
• - Knowledge of for industrial applications in a commercial/finance/industrial/manufacturing settings.
• - Exposure to Industrial business data domains
• Leadership Skills:
• A good team player with self-driven execution capabilities.
• Ability to communicate ideas clearly with cross teams.
• Ability to showcase teamwork skills to achieve common goals, provide resolutions and share ideas.
• Demonstrate the presentation and influencing skills