Data Engineer

Experience: 10+ Years

ABOUT

5Y began in 2011 as the Engineering Lab in India, to serve as an R&D centre for building innovative products. 5Y was established as a company where product ideas could be incubated and matured. We built multiple products alongside
executing on customer projects.
As 5Y developed multiple products for customers, we started conceptualizing a Technology Framework that would make development of any project easy and can remove many months of repeat work while also bringing resilience, scalability, and efficiency to the product that was built on it.
Our core team toiled to build such a product and today, we are very proud to present BOS Framework” to the world!

KEY RESPONSIBILITIES

  • Collaborate with businesses and other stakeholders to participate in product or solution designs.

  • Develop robust, scalable and sustainable data products or solutions utilizing cloud-based technologies - Snowflake / any equivalent

  • Design, develop, and optimize relational and NoSQL databases for diverse applications, including AI and large-scale data processing.

  • Provide moderately complex technical support through all phases of product or solution life cycle.

  • Perform data analysis, handle data modeling and configure and develop data pipelines to move and optimize data assets.

  • Build moderately complex prototypes to test new concepts and provide ideas on reusable frameworks, components and data products or solutions and help promote adoption of new technologies.

  • Independently solve moderately complex issues with minimal supervision, while escalating more complex issues to appropriate staff.

  • Other duties as assigned

  • Design and develop Big Data Solutions to enable our business's success.

  • Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities

  • Implementing the Ingestion & ETL processes

  • Monitoring performance and advising any necessary infrastructure changes

  • Ability to carry out code development and design on analytical projects for the full analytical stack from the data acquisition up to the consumption of the data

  • Writing scalable, robust, testable, efficient, and easily maintainable code.

  • Playing a key role in architectural and design decisions, building toward an efficient micro service distributed architecture

  • Design and construction of REST API

  • Identify bottlenecks and bugs, and devise solutions to these problems.

  • Help maintain code quality, organization and automatization.

  • Design and implementation of continuous integration and deployment

REQUIRED SKILLS AND QUALIFICATION

  • Bachelor's degree in a related field or equivalent experience- B.E. / B.Tech/
    C.S.E/ Electronics/

  • Minimum of 5 years of related work experience

  • Experience with Big Data technologies (i.e. Hadoop, Spark, impala, Hive etc.)

  • Strong knowledge and hands on work experience of writing the programs in scala / python for Spark framework

  • Proficient in SQL and advanced SQL and able to write the complex SQL queries

  • Work with the product teams and build robust and scalable data integration
    (ETL) pipelines using Spark and Scala / Python /SQL

  • Experience in visualization tools, such as Tableau and PowerBI, and cloud data warehouses such as SnowFlake

  • Strong team player and creative thinker who can lead technical teams and cross-functional groups.

  • Strong data-driven problem-solving skills.

BENEFITS

  • 100% Company paid comprehensive medical insurance for you, your spouse,and children

  • Paid time off

  • Market competitive total compensation package

  • Paid Maternity & Parental leave

  • Your voice is heard; no matter your level, we're a team, all going in the same direction

CULTURE AND VALUES

Be Open: When knowledge becomes open, we can come together as a team to collaborate around a shared purpose

Customer Focus: Our customers’ success is our success

Lead Change: Everyone at BOS has the capacity to make an impact on the customers

Result Oriented: Driving results in a measurable way ensures we stay focused on the highest impact initiatives

One Team: We can’t win without each other