This listing was posted on Professional Diversity Network.
Data Engineer
Location:
Norfolk, VA
Description:
ID: 532617 Location: Norfolk Va, US Data Engineer Led by Rodolphe Saadé, the CMA CGM Group, a global leader in shipping and logistics, serves more than 420 ports around the world on five continents. With its subsidiary CEVA Logistics, a world leader in logistics, and its air freight division CMA CGM AIR CARGO, the CMA CGM Group is continually innovating to offer its customers a complete and increasingly efficient range of new shipping, land, air and logistics solutions. Committed to the energy transition in shipping, and a pioneer in the use of alternative fuels, the CMA CGM Group has set a target to become Net Zero Carbon by 2050.Through the CMA CGM Foundation, the Group acts in humanitarian crises that require an emergency response by mobilizing the Group's shipping and logistics expertise to bring humanitarian supplies around the world. Present in 160 countries through its network of more than 400 offices and 750 warehouses, the Group employs more than 155,000 people worldwide, including 4,000 in Marseilles where its head office is located. We are seeking an experienced Senior Data Engineer to join our expanding team of analytics professionals. The chosen candidate will take on the responsibility of enhancing and streamlining our data and data pipeline architecture, with a focus on optimizing data flow and collection for cross-functional teams. The ideal candidate is a skilled data pipeline builder and data wrangler who finds satisfaction in optimizing and constructing data systems from the ground up. As a Senior Data Engineer, you will collaborate with software developers, database architects, BI developers, and data scientists on various data initiatives, ensuring that the delivery architecture aligns with optimal standards across ongoing projects. The role requires a self-directed individual comfortable with meeting the data requirements of multiple teams, systems, and products. The ideal candidate will be enthusiastic about the opportunity to enhance or redesign our company's data architecture in support of our upcoming generation of products and data initiatives ESSENTIAL DUTIES / RESPONSIBILITIES * Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements.* Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.* Constructing the AWS data pipelines using VPC, EC2,S3, Auto Scaling Groups, IAM , CloudWatch , Cloud Front, lambda, DMS, Glue ...etc* Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.* Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues KNOWLEDGE, SKILLS AND ABILITIES REQUIRED * 8 Years of strong work experience in Data Engineering using AWS, Pyspark, Python and SQL.* Constructing the AWS data pipelines using VPC, EC2,S3, Auto Scaling Groups, IAM , CloudWatch , Cloud Front, lambda, DMS, Glue ...etc* Strong understanding of Python and Pyspark Data engineering* experience working with CICD pipeline using tools like Terraform, Jenkins, aws code commit, code pipeline and CloudFormation etc.* Hands on experience in data modeling and dimensional modeling.* exposure to full Lifecycle of Data warehouse projects* Designing and developing data models and writing complex SQL queries to extract, manipulate and analyze data.* Build ETL pipeline end to end from AWS S3 to Snowflake Datawarehouse for analytical.* Build Glue code to extract transform and load using pyspark common code and model.* experience working with Airflow for automation of AWS and Snowflake is a plus* snowflake expertise good to have.* Strong experience working with SQL and PLSQL procedures is a must* Familiarity or Working experience with one of BI & Analytical applications like Qlik Sense, Microsoft Power BI, Tableau* Any Cloud Application, Database, Data Integration, Business Intelligence Application Certifications are preferable.* Exposure to Data Streaming, and Data API Design & Development experience would be preferable. EDUCATION AND EXPERIENCE REQUIREMENTS * Bachelors Degree is required; Master's Degree or Advanced Degree preferred.* 8 years of development experience using SQL or PL/SQL* 8 years of development experience with any ETL/ELT tool like SSIS, Informatica, Data Stage, Data Bricks, AWS Glue / Lambda, Azure Data Factory or any equivalent tool* 6 years of Programming experience using Python, UNIX Shell Scripting, or Windows Power Shell* 4 years of experience using Apache Spark, PySpark, Big Data Echo System etc.,* 4 years of experience with any Cloud Platform like AWS, Azure, or Google Cloud Platform* 2 years of experience with one of Data Modeling applications like ERWIN, ER/Studio Data Architect, or SAP PowerDesigner* 2 years of experience with one of Job Scheduling applications like ActiveBatch, Autosys, IB Come along on CMA CGM's adventure! CMA CGM (America) LLC is committed to equal employment opportunity for all qualified persons without regard to race, color, religion, sex, national origin, pregnancy, age, sexual orientation, marital status, gender identity, veteran status, disability, or any other legally protected classification. Nearest Major Market: Hampton Roads PDN-9b7e7597-8b22-4cea-aadb-c36fde85ee3c
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to Professional Diversity Network
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Data Engineer
Data Engineer is a Engineering Engineer Job at Monster located in Norfolk VA. Find other listings like Data Engineer by searching Oodle for Engineering Engineer Jobs.
Data Engineer is a Engineering Engineer Job at Monster located in Norfolk VA. Find other listings like Data Engineer by searching Oodle for Engineering Engineer Jobs.