Java Spark Big Data Engineer

You will work on: 

We help many of our clients make sense of their large investments in data – be it building analytics solutions or machine learning applications. You will work on cutting edge cloud-native technologies to crunch terabytes of data into meaningful insights. 

What you will do (Responsibilities):

• Collaborate with product management & engineering to build highly efficient data pipelines for large datasets.
• Perform Data quality analysis on disparate data sources and define, implement data quality rules
• Design and develop data models analyzing end to end data requirements
• Troubleshooting data loss, data inconsistency, and other data-related issues
• Product development environment delivering stories in a scaled agile delivery methodology.

What you bring (Skills):

• 2-5 year of experience in hands-on data engineering & medium scale distributed applications
• Good experience in object-oriented programming languages such as Java or Scala
• Sound experience in RDBMS such as MySQL, Oracle, SQLServer, etc and.or Cloud appliances as Snowflake, Redshift, BigQuery, Azure Synapse etc.
• Experience in big data processing technologies such as Hadoop, Spark, Kafka, Databricks, etc.
• Experience in Cloud-based services such as Amazon AWS, Microsoft Azure, or Google Cloud Platform
• Experience in developing and deploying applications in Linux OS
• Experience with Scrum and/or other Agile development processes
• Strong analytical and problem-solving skills
• Team player with self-drive to work independently
• Strong communication and interpersonal skills

Great if you know (Skills):

• Some exposure to containerization technologies such as Docker, Kubernetes, or Amazon ECS/EKS
• Some exposure to NoSQL data stores such as Couchbase, Solr, etc.
• Some exposure to Perl, or shell scripting or orchestration tools like Airflow
• Ability to learn new technologies on his/her own, perform POCs

Advantage Cognologix:

• A higher degree of autonomy, startup culture & small teams
•  Opportunities to become an expert in emerging technologies
•  Remote working options for the right maturity level
•  Competitive salary & family benefits
•  Performance based career advancement

About Cognologix:

Cognologix helps companies disrupt by reimagining their business models and innovate like a Startup. We are at the forefront of digital disruption and take a business-first approach to help meet our client’s strategic goals.

We are a Data focused organization helping our clients to deliver their next generation of products in the most efficient, modern, and cloud-native way.