Stay in Touch

TITLE

 

Data Engineer

COMPANY

 

Qubole

LOCATION

 

Bangalore, IN

Description

Qubole, the leading cloud-agnostic, big data-as-a-service provider, is passionate about making data-driven insights easily accessible to anyone. Qubole delivers the industry’s first autonomous data platform. The cloud-based data platform, Qubole Data Service (QDS), removes the burden of maintaining infrastructure of multiple big data processing engines, and enables customers to focus on their data. Qubole customers process nearly an exabyte of data every month. Qubole investors include Charles River, Institutional Venture Partners, Lightspeed, Norwest, Harmony and Singtel Innov8. 
 
The Data Apps team collects all data generated internally at Qubole and publishes it for internal consumption as well as builds data driven products out of the same. You will be one of the first engineers on this team and will work closely with Product and Engineering teams and Customers to drive and implement the first ever data driven products in the emerging market segment of Big-Data-as-a-Service.

Your Part

    • Design data warehouse using Cloud Storage for data analysis using Hive/Spark etc.
    • Write ETL pipelines in Hive and Spark for loading data into a Cloud based Data Warehouse.
    • Write agents in Bash/Python/Java to publish data from different distributed data sources 
    • Design and manage real-time data ingestion using Apache Kafka and RoR based web-service.
    • Work with product and engineering teams on different data driven products and help drive/implement the Data flows for the same.
    • Perform ad-hoc data analysis to test various hypothesis using SQL/Scala/Python
    • Mentor a team of engineers while maintaining a hands-on role.

Must Have

    • Hands on experience in BigData space (Kafka, Spark, Hadoop Stack like M/R, Hive, HBase, Sqoop, etc..NoSQL stores like HBase etc)
    • Designing, integrating and documenting technical components for seamless data extraction and analysis on big data platform
    • Passionate for continuous learning, experimenting, applying and contributing towards cutting edge open source technologies and software paradigms
    • Ensuring best practices that can be adopted in BigData stack and share across teams and BUs.
    • Provides operational excellence through root cause analysis and continuous improvement in technologies and processes.
    • Programming experience with Java & Python. 
    • Experience managing software projects.
    • Bachelors Degree in Computer Science, or related discipline with minimum 6 years experience.

Nice to Have

    • Prior experience in actively contributing to open source projects like Hadoop/Spark/Hive/HBase
    • Experience in applied machine learning.
    • Academic research experience in the area of distributed systems and query processing.
    • Advanced Degree (MS or PhD in Computer Science).
We have a employee friendly work environment with a liberal work from home policy and expense reimbursement policy at work. We pride ourselves in lack of bureaucracy and delegate power and responsibility aggressively to employees. Self-Starters and those who thrive on complexity and independence love Qubole.
 
Qubole is hitting that growth inflection point where we need talented people to help us scale up. Our company culture is special, and we are looking for people to join us who want to continue building a great company while going after the big data activation market.
Check us out on Glassdoor and LinkedIn
Learn more about us herehere, and here
 
If you want to get technical, click here for a 5 min run down of how Qubole works
Watch a talk given by our CEO here
 
Culture at Qubole
Trust and Autonomy: We absolutely pride ourselves on the lack of bureaucracy at work, and believe in delegating power and responsibility, aggressively to our employees.
Transparency and Teamwork: Complete transparency in all our thoughts and actions is integral to our genetic character, and it helps us to stick together and function effectively as a team.
Who Thrives: If you are a self-starter and thrive on complexity and independence and truly understand and live the tenets of humility, hunger and honesty and you will love Qubole.

Apply for the job

Subscribe to our blog.


 

Blog & Newsletter Signup