Job Detail
Category
IT
Functional Area
Core Java, Springboot, Cloud Technologies, Data virtualization and caching platforms, Experience designing, building and testing Java EE applications
Location
Karachi
Job Type:
Full Time/Permanent
Qualifications
Bachelor’s and/or Master’s degree in Computer Science, Computer Engineering or related technical discipline
Experience
8+ years of experience with Spark, Hadoop, Hive, Presto and KafkaOffered Salary
Market Competitive + Other benefits
Job Description
Data engineer Lead will build data pipelines that synthesize data from millions of customers and convert it into useful information for trends and behavior analysis. The role requires a blend of technical competence, bias to action and extreme ownership of the code base or the task at hand. Our client’s platform is built on cutting edge tech and will provide ample opportunity to budding and experienced data engineers alike to learn and grow professionally.
Skills
Currently hands on building big data pipelines
Relational, NoSQL and SQL databases including MongoDb and Postgres
Stream-processing systems like Spark-Streaming and Storm
Data storage formats like parquet
Object function/object-oriented scripting languages including Scala, C++, Java and Python
Familiar with configuring CI/CD pipelines in GitHub, bitbucket or Jenkins for building application binaries
Workflow management and pipeline tools such as Airflow, Luigi and Kubeflow
Experience with machine learning frameworks such as Tensorflow, Keras and libraries such as scikit-learn
Columnar Stores such as AWS Redshift