Qubole, the leading cloud-agnostic, big data-as-a-service provider, is passionate about making data-driven insights easily accessible to anyone. Qubole delivers the industry’s first autonomous data platform. The cloud-based data platform, Qubole Data Service (QDS), removes the burden of maintaining infrastructure of multiple big data processing engines, and enables customers to focus on their data. Qubole customers process nearly an exabyte of data every month. Qubole investors include Charles River, Institutional Venture Partners, Lightspeed, Norwest, Harmony and Singtel Innov8.
Qubole application processes 750+ petabytes of data every month across multiple cloud platforms. To ensure that our customers have a smooth experience using our platform, our support team works round the clock to provide quick resolutions. For this, they rely on logs generated by all the subsystems in Qubole. The challenge in this role is to build a business critical tool, that can cover all such subsystems like RoR, Cloud (AWS,Azure, GCE), big data engine log foot prints, extract useful information and there by reduce the overall issue resolution time. We are looking for Automation engineers with strong scripting skills in Python and shell, who can help us achieve the same.
What you will be doing :
We are looking for Tools Development Engineer with strong development skills in Python and shell, to carry out the below responsibilities :
Feature Development and bug fixes for various Qubole Internal Tools
Simplify pain points of developers by providing continuous improvements in developer workflows using jenkins, k8s.
Innovate and Ideate to automate all tasks related to building, testing, and delivering or deploying software.
Develop Process and Workflows to main code stability.
Handle Multi-cloud (AWS, Azure, and Oracle) qubole image creation process.
Administrate and provide automation around JIRA and Bitbucket, Atlassian Products.
Wear cloud admin hat for aws, azure, gcp from time to time
Understand the design of complex software systems in the area of parallel data processing - cloud, cluster orchestration.
Excellent troubleshooting skills of systems integrated with multiple backends and architectures
Must to Have :
Good programming ability in Python
Experience debugging complex systems software like a database, big data
Exposure to the Unix environment
Degree in Computer Science.
Good to Have :
Experience in Administrating Jenkins
Prior Experience with Packer is an advantage.
Knowledge of AWS cloud technologies.