Software Engineer
Spellbrush, San Francisco +1
- Pay
- Not listed by the employer
- Work type
- Not stated
- Level
- Not stated
- Area
- Software engineering, Inference & ML systems, ML / AI engineering
- Posted
- Oct 30, 2024
About the role
[https://app.ashbyhq.com/api/images/user-content/89c1442c-bd9c-46be-a910-20b49b5d9ffc/20ffb2db-1beb-429d-894f-ebb50a85bdb2/image.png]
GENERALIST SOFTWARE ENGINEER
ABOUT US
Here at Spellbrush, we're passionate about making a good anime game.
We also happen to be the world's leading generative AI studio — we're the team behind niji・journey https://nijijourney.com/.
We are currently investigating how AI can be used to help human artists perform masterpieces in the most complex medium of our times: videogames.
Our games are characterized by a no-compromise approach to well-balanced gameplay married to a truthful love of visual arts.
If you love turn-based tactics games, please consider applying!
ABOUT THE ROLE
As Spellbrush continues to grow rapidly, we're seeking talented generalist engineers to join our team and help us build advanced data pipelines, foundational datasets, as well as the tools and infrastructure that support them. If the thought of running a batch job across ten-thousand GPUs to ingest petabytes worth of anime image and videos excites you, this is the job for you!
WHAT YOU'LL ACHIEVE
You'll define the processes and infrastructure to transform and make data readily available across the company, whether it be embeddings, video, bounding boxes, or more.
You'll partner with our world class AI researchers to understand their needs, and then design, build and monitor pipelines that meet today's requirements but can gracefully scale with our growing data size.
SKILLS YOU'LL NEED TO BRING
You are a self-starter and can work directly with the research team to gather and synthesize high-impact needs from teammates, designing and implementing the appropriate technical solutions, and effectively communicating about deliverables, timelines and tradeoffs.
You've spent 3+ years as software engineer, with a wide generalist skillset.
You’ve worked with distributed systems, and previously administered a big data toolset (Ray, Spark, Airflow, etc.).
You have hands-on experience shipping scalable data solutions in the cloud (e.g AWS, GCP, Azure, etc.), across multiple data stores (e.g Snowflake, Redshift, Hive, SQL/NoSQL, etc.).
You’re comfortable pulling data from whatever source it may be in, whether that involves writing a complex SQL query to pull a billion rows out of a Bigquery Database, or coordinating the transfer of 10+ PB of data across two S3 regions.
You are highly comfortable with scripting, whether in Typescript, Python, or even Bash when the need arises.
Most importantly, you know when to pull in the complex overengineered tools, and when to instead rely on duct tape.
YOU MAY BE A GOOD FIT IF:
YOU HAVE HANDS-ON EXPERIENCE IN DESIGNING AND BUILDING HIGHLY SCALABLE AND RELIABLE DATA PIPELINES
Building data pipelines for AI presents itself with unique challenges. If you’ve previously built large scale big data pipelines, you’d be a good fit.
Similar roles at other companies
Pay not posted
Posted 18 days ago
Pay not posted
Posted 18 days ago
$140K–$200K / yr
Posted 18 days ago
$140K–$200K / yr
Posted 18 days ago
Listed on Spellbrush's Ashby job board; checked 22 h ago. First seen by us 24 h ago. Being listed doesn't mean the team is actively interviewing. We found this board in a public directory and haven't yet confirmed it against the company's own careers page.