We are seeking a Senior Application Engineer for the Apache Spark Acceleration group.

Apache Spark is the leading big data processing engine, powering a broad spectrum of data-driven initiatives. From data integration and preparation to advanced analytics and business intelligence, Spark accelerates the extraction of insights from complex datasets. As organizations strive to make data-informed decisions, the efficiency of their data processing workflows is crucial. Every hour saved in processing, analyzing, and gaining visibility into large datasets directly impacts the agility and responsiveness of the business, making optimized data processing a key strategic imperative.

At NVIDIA, we are passionate about working on hard problems that have an impact. You will need to have previous experience working with strong programming skills, implementing real-world Apache Spark applications, and familiarity with open source big data processing frameworks. As an application architect, you will define reference architecture for customers and CSPs to accelerate Apache Spark applications, and be a member of technical leadership for RAPIDS Accelerator for Apache Spark. You will be working closely with an NVIDIA engineering team working on the RAPIDS Spark open source libraries.

What you'll be doing:

• Serve as a lead application architect in RAPIDS Accelerator for Apache Spark.

• Define reference architecture of accelerated Apache Spark applications for major industry verticals.

• Lead the technical engagement with select customers and partners to accelerate Apache Spark applications with GPUs.

• Work closely with NVIDIA Spark engineering teams in architecture design and system implementations.

• Partner with Solution Architects to understand customer’s existing big data and ML/DL solution architecture.

• Conduct regular technical customer meetings for project/product roadmap, feature discussions, customer issue resolution and performance tuning.

• Build and work on the PoC for solutions that address customer’s critical business needs.

• Develop applications to promote best practices for accelerated data analytics and machine/deep learning in various industry verticals.

• Build tools to analyze data processing workloads to find opportunities for acceleration and cost savings.

• Work with major cloud service providers and Apache Spark vendors globally.

• Engage open source communities, including Apache Spark and RAPIDS, for technical discussions and contributions.

What we need to see:

• BS, MS, or PhD in Computer Science, Computer Engineering, or closely related field

• 12+ years of work or research experience in software development

• Excellent programming skills for manipulating data frames in Python, Scala, Java or SQL

• Strong problem solving skills coupled with customer-facing communication skills

• Knowledge of open source big data open source ecosystem (Apache Hadoop, Spark, Hive, Presto, Airflow, Kafka, etc)

• Able to work successfully with multi-functional teams across organizational boundaries and geographies

• Excellent at communicating, presenting and explaining technical topics

• Efficient time management skills, capable of balancing multiple tasks

Ways to stand out from the crowd:

• External customer facing skill-set and background

• Experience or exposure to cloud platforms like AWS, Azure, GCP, or Aliyun

• Committership at major open source projects (such as Apache Spark, Apache Hadoop, Apache Flink, Apache Kafka) would be a huge plus

With highly competitive salaries and a comprehensive benefits package. NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you creative, autonomous, and passionate about Spark? If so, contact us!

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.