San Jose, US-United States, Seattle, US-United States
Posted 7 months ago
| About The Company This company pioneers short-form video creation and social engagement, boasting a vast, engaged user base. Its platform empowers users with creative tools, filters, and effects. With a diverse content ecosystem, it’s a hub of creativity and expression. The proprietary algorithm ensures personalized content feeds, enhancing user engagement and satisfaction. This company wields significant influence on digital media, making it an invaluable partner for innovative collaborations and marketing endeavors. About The Team We are Generative AI team under Monetization Technology. Our team focuses on developing cutting-edge Generative AI techs across all modalities, including text, image, videos, landing pages, etc., and creates industry-leading technical solutions to improve creative efficiency for advertisers, agencies and creators. We are committed to automated creative workflows by leveraging Generative AI technologies, to increase overall revenue for advertisers, agencies and creators. We aim to drive and lead the generative AI in the ads tech and creative industry, powering products and driving values for our clients, creators, and the whole ecosystem. We are looking for infrastructure engineers who are excited to grow their business understanding, build highly scalable and reliable software/infrastructure, partner across functions with global teams, and make big impacts. If you are someone who welcomes challenges, we are eager to have you on the team! Responsibilities – Work closely with infrastructure architects and SREs and to enhance the Generative AI Platform’s availability, scalability, and cost-efficiency. – Engineer robust, high-performance data processing and large language model training/inference pipelines, drive engineering excellence and optimization initiatives to ensure the most effective use of resources, including cost optimization and performance tuning of the ML platform. – Collaborate with model researchers and data pipeline engineers, providing them with a state-of-the-art platform that accelerates the development and deployment of innovative ML models. – Keep up-to-date with the latest technological advancements, especially in machine learning infrastructure, to adopt and implement cutting-edge solutions that boost platform efficiency and performance. Minimum Qualifications 1. B.S./M.S./Ph.D. in Computer Science, Computer Engineering, or a related field. 2. Programming Skills: Proficiency in Python and familiarity with deep learning frameworks such as PyTorch. Experience with high-performance networking and database libraries like FSDP/DeepSpeed and asyncio. 3. Systems Proficiency: Solid skills in Linux, Docker, Kubernetes, and an understanding of high-performance computing principles, including Infrastructure as Code (IaC). 4. Technical Expertise in generative AI engineering: Demonstrated expertise in enhancing scalability, efficiency, and cost-effectiveness, particularly in GPU-intensive environments. This includes comprehensive technical proficiency in high-performance computing, deploying, and managing extensive ML workloads efficiently. Preferred Qualifications 1. Technical Skills: A strong preference for candidates with good experience in CUDA, training/inference FP8/FP4 optimization etc. 2. Cloud Infrastructure and DevOps: Expertise in cloud infrastructure platforms such as AWS/GCP. collaborating with DevOps/SRE teams to deploy and manage extensive ML projects, encompassing both the training and inference phases. 3. Experience with Scheduling Services: Familiarity with scheduling services like Linux Slurm, Kubernetes Volcano, or third-party tools like Run.AI, etc. 4. Distributed Computing: Experience in large-scale ML training and deployment, familiarity with distributed computing frameworks such as Ray.io. 5. Soft Skills: An enthusiastic approach to technology and engineering, supported by exceptional problem-solving abilities, and proficiency in communication, collaboration, and project management. |
Job Features
| Job Category | AI Engineering |
| Seniority | Staff IC / Senior Staff IC / Architect |
| Base Salary | $210,000 - $280,000 |
| Recruiter | levana.lyu@ocbridge.ai |
