Posted on
Summary
Hiring a Senior Data Engineer to help us organize, standardize, and gain insights from the tremendous amount of data generated from our community and auction marketplace. The ideal candidate has experience across the full stack, and is a self-starter who loves to code, is Certified to work with Amazon Web Services (AWS).
Responsibilities
• Develop and maintain data pipelines and warehouses/storage infrastructure via automation
• Maintain current infrastructure while leading the charge as we migrate to AWS
• Develop applications that help software engineers do their jobs at a faster pace with less overhead
• Work closely with development teams to architect and implement applications in a secure and highly available manner
• Continued support and modernization of the WordPress Bring A Trailer website and backends
• Troubleshoot and identify the root cause of issues in a complex environment
• Provide 24/7 on-call support on a rotating basis
Requirements
• Minimum 8 years of professional experience deploying and supporting high-traffic, scalable
• web applications/services
• Build data pipelines based on Amazon Kinesis, AWS Lambda, Amazon Glue, and Amazon
• Athena
• Build data normalization, transformation, and cleansing processes
• Contribute to the development and maintaining data dictionaries, catalogs, schemas, and metadata
• Design a Data Lake for Analytics, Business Intelligence, and ML use cases
• Proficient in database management systems (SQL and NoSQL)
• Create reports and visualizations suited for different persons
• Familiarity with data engineering and analytics industry best practices and tools such as
• DAGs, data modeling, data dictionaries, data governance practices, data QA and monitoring, etc.
Expertise with the following AWS Services:
• DynamoDB
• Kinesis
• Lambda
• RDS
• DataLake Formation
• S3
• Athena
• Sage Maker
• Redshift
• AWS Glue
• ETL
• Quick Sight
Preferred Experience
• Experience in a consumer-focused technology company.
• Experience with or domain knowledge in the automotive industry, with two-sided markets, or e-commerce generally
— Warmest Regards — Mohammad ShadanPh – Email –