Senior Software Engineer - Data Engineering

Bloomberg • Skillman, New Jersey, United States • $160k - $240k / year • 3m ago

Our Team:

Bloomberg runs on data. As the Data Management & Analytics team within Engineering, we support our organization’s needs around managing data efficiently and enabling everyone across the company to make informed decisions using self service data analytics tools. We are responsible for ingesting and preparing massive amounts of data and ensuring that the data is properly modeled, governed, accurate and protected for reporting and advanced analytics. A key objective of this role is for you to help build and support company wide data analytics programs leveraging data engineering technologies such as Hadoop, Pyspark, Flink, Airflow and traditional MPP Data Warehouse/ETL technologies.

We’ll trust you to:

Proactively drive the vision for Data Analytics across multiple business areas, and define and execute on a plan to achieve that vision.
Build high-quality, scalable and robust data engineering applications with the goal of providing end users with self-service analytics.
Be proficient at developing, architecting, standardizing and supporting technology platforms using open source technologies such as Pyspark, Airflow and industry leading ETL solutions.
Build data pipelines by ingesting petabytes of data using real-time streaming tools like Kafka, Flink. Maintain and support these data pipelines and ensure they are scalable and highly available.
Incorporate exceptional handling, logging and auditing procedures within data pipelines codebase.
Leverage open source frameworks around workflow automation, orchestration and job scheduling.
Integrate data management capabilities such as data modeling, data quality, data anonymization throughout the data lifecycle - data in transit and data at rest.
Collaborate and build cross functional relationships with Product Owners, Data Scientists and Software Engineers to understand business and deliver on those needs.
Embrace agile framework with iterative product development and continuous improvement mindset.
Stay up to date with market trends, bring new ideas on-board and evaluate tooling for future needs.
Be highly motivated to drive innovations across engineering.

You’ll need to have:

7+ years of experience designing and developing complex data engineering solutions.
5+ years of experience building ETL frameworks using Python/Pyspark and Hadoop/Hive.
2+ years of experience on any Industry Standard Orchestration tools, e.g. Tidal, Airflow, Autosys.
3+ years of experience in distributed parallel computing databases for Data Warehousing needs.
3+ years of experience using real-time streaming frameworks such as Kafka, Flink.
Strong understanding of data warehousing methodologies, ETL processing and dimensional data modeling.
Advanced SQL proficiency and data modeling experience. Knowledge of database design techniques.
Demonstrated experience and ability to work with business users to gather requirements and manage scope.
Strong communication, presentation, problem-solving, and trouble-shooting skills.
BA, BS, MS, PhD in Computer Science, Engineering or related technology field.

We’d love to see:

Experience working with extremely large data volumes, large databases and data warehouse implementations.
Understanding of VLDB performance aspects, such as table partitioning, sharding, table distribution and optimization techniques.
Prior working experience with ETL tools such as Informatica/IDMC.
Knowledge of reporting tools such as QlikSense, Tableau, PowerBI.

Salary Range = 160000 - 240000 USD Annually + Benefits + Bonus

The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.

We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.

ACCOMMODATIONS

Bloomberg provides reasonable adjustment/accommodation to individuals with disabilities. Please tell us if you require a reasonable adjustment/accommodation to apply for a job. Examples of reasonable adjustment/accommodation include but are not limited to making a change to the application process or work procedures, providing documents in an alternate format or using specialized equipment. To request an adjustment/accommodation to apply for a job, please email AMER_recruit@bloomberg.net (Americas), EMEA_recruit@bloomberg.net (Europe, the Middle East and Africa), or APAC_recruit@bloomberg.net (Asia-Pacific), based on the region you are submitting an application for.

EQUAL OPPORTUNITY

Bloomberg is an equal opportunity employer and prohibits discrimination in employment. It is Bloomberg’s policy to provide equal opportunity and access for all persons, and the Company is committed to attracting, retaining, developing, and promoting the most qualified individuals without regard to age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or maternity/parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law (each, a “Protected Characteristic”). Bloomberg prohibits treating applicants or employees less favorably in connection with the terms and conditions of employment, in all phases of the employment process, because of one or more Protected Characteristics.