OpenAI unveils its own custom Jalapeño inference chip

OpenAI has announced its own custom inference chip, code-named Jalapeño, as part of a broader push to reduce dependence on third-party silicon for running its models at scale.

Custom inference chips let large AI labs optimize hardware specifically for their own model architectures, a route Google and Amazon have already taken with their own in-house accelerators.