On behalf of our client, AgileEngine is looking for a Middle Data Engineer to develop front- and back-end solutions for the internal products. The ideal candidate’s prior work experience reflects high standards for engineering with proven capabilities. The candidate possesses the ability to take on important business challenges and execute them with precision and quality.
What is required?
- 3+ years experience in software development
- BS in Computer Science or equivalent practical experience
- Strong practical experience with SQL and Python (ideally 2+ years) for Data Engineering
What will be a plus?
- Matillion for automation
- Experience with Cron jobs configuration
- VoD experience
What you will do:
- Implement assigned features and break them down into tasks
- Estimate and implement tasks for the features
- Perform peer reviews of code
- Perform QA of the completed functionality
What we offer:
- Interesting and challenging tasks
- Flexible work schedule
- Zero bureaucracy
- Friendly and a very skilled team with great corporate culture and mentorship (visit us and see it yourself)
- US democratic management style
- Opportunities for self-realization, professional and career growth
- Cool events and team activities
- Professional workshops and training, a great engineering culture
About the project
The client team has a number of internal Data Science and Data Engineering tasks and initiatives of high priority for its VoD platform that require contractor team support:
-Take atomic data and transform it into molecular data
-Apply Data Engineering to transform the data into useable format for Data Science analysis
-Data from Snowflake environment’s tables of data should be updating into aggregated tables on a daily basis
-Tableau reports need to be developed from this aggregated tables
-Existing models in python on Sagemaker (AWS) are currently manual and need to be automated
-Snowflake data written and python needs to either be moved into Sagemaker and automated or rewritten in SQL and automated on Snowflake using Matillion
-Potential to develop a web scraping tool for publicly available information and storing it in Snowflake clean tables.