{"id":4112137,"date":"2025-12-30T10:24:58","date_gmt":"2025-12-30T15:24:58","guid":{"rendered":"https:\/\/www.computerworld.com\/article\/4112137\/nvidia-licenses-groqs-inferencing-chip-tech-and-hires-its-leaders-3.html"},"modified":"2026-01-05T08:30:55","modified_gmt":"2026-01-05T13:30:55","slug":"nvidia-licenses-groqs-inferencing-chip-tech-and-hires-its-leaders-3","status":"publish","type":"post","link":"https:\/\/www.computerworld.com\/article\/4112137\/nvidia-licenses-groqs-inferencing-chip-tech-and-hires-its-leaders-3.html","title":{"rendered":"Nvidia licenses Groq\u2019s inferencing chip tech and hires its leaders"},"content":{"rendered":"<div id=\"remove_no_follow\">\n\t\t<div class=\"grid grid--cols-10@md grid--cols-8@lg article-column\">\n\t\t\t\t\t  <div class=\"col-12 col-10@md col-6@lg col-start-3@lg\">\n\t\t\t\t\t\t<div class=\"article-column__content\">\n<section class=\"wp-block-bigbite-multi-title\"><div class=\"container\"><\/div><\/section>\n\n\n\n<p>Nvidia has licensed intellectual property from inferencing chip designer Groq, and hired away some of its senior executives, but stopped short of an outright acquisition.<\/p>\n\n\n\n<p>&ldquo;We&rsquo;ve taken a non-exclusive license to Groq&rsquo;s IP and have hired engineering talent from Groq&rsquo;s team to join us in our mission to provide world-leading accelerated computing technology,&rdquo; an Nvidia spokesman said Tuesday, via email. But, he said, &ldquo;We haven&rsquo;t acquired Groq.&rdquo;<\/p>\n\n\n\n<p>Groq designs and sells chips optimized for AI inferencing. These chips, which Groq calls language processing units (LPUs), are lower-powered, lower-priced devices than the GPUs Nvidia designs and sells, which these days are primarily used for training AI models. As the AI market matures, and usage shifts from the creation of AI tools to their use, demand for devices optimized for inferencing is likely to grow.<\/p>\n\n\n\n<p>The company also rents out its chips, operating an inferencing-as-a-service business called <a href=\"https:\/\/www.networkworld.com\/article\/4075762\/ibm-signs-up-groq-for-speedy-ai-inferencing-option.html\">GroqCloud<\/a>.<\/p>\n\n\n\n<p>Groq itself announced the deal and the executive moves on Dec. 24, saying &ldquo;it has entered into a <a href=\"https:\/\/groq.com\/newsroom\/groq-and-nvidia-enter-non-exclusive-inference-technology-licensing-agreement-to-accelerate-ai-inference-at-global-scale\" target=\"_blank\" rel=\"noreferrer noopener\">non-exclusive licensing agreement with Nvidia for Groq&rsquo;s inference technology<\/a>&rdquo; and that, as part fo the agreement, &ldquo;Jonathan Ross, Groq&rsquo;s Founder, Sunny Madra, Groq&rsquo;s President, and other members of the Groq team will join Nvidia to help advance and scale the licensed technology.&rdquo;<\/p>\n\n\n\n<p>The deal could be worth as much as $20 billion, <a href=\"https:\/\/techcrunch.com\/2025\/12\/24\/nvidia-acquires-ai-chip-challenger-groq-for-20b-report-says\/\" target=\"_blank\" rel=\"noreferrer noopener\">TechCrunch reported<\/a>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"a-way-out-of-the-memory-squeeze\">A way out of the memory squeeze?<\/h2>\n\n\n\n<p>There&rsquo;s tension throughout the supply chain for chips used for AI applications, leading to Nvidia&rsquo;s CFO reporting in its last earnings call that some of its chips are &ldquo;sold out&rdquo; or &ldquo;fully utilized.&rdquo; One of the factors contributing to this identified by analysts is a shortage of high-bandwidth memory. Finding ways to make their AI operations less dependent on scarce memory chips is becoming a key objective for AI vendors and enterprise buyers alike.<\/p>\n\n\n\n<p>A significant difference between Groq&rsquo;s chip designs and Nvidia&rsquo;s is the type of memory each uses. Nvidia&rsquo;s fastest chips are designed to work with high-bandwidth memory, the price of which &ndash; <a href=\"https:\/\/www.networkworld.com\/article\/4093752\/server-memory-prices-could-double-by-2026-as-ai-demand-strains-supply.html\">like that of other fast memory technologies<\/a> &mdash; is soaring due to limited production capacity and rising demand in AI-related applications. Groq, meanwhile, integrates static RAM into its chip designs. It says SRAM is faster and less power-hungry than the dynamic RAM used by competing chip technologies &mdash; and another advantage is that it&rsquo;s not (yet) as scarce as the high-bandwidth memory or DDR5 DRAM used elsewhere. Licensing Groq&rsquo;s technology opens the way for Nvidia to diversify its memory sourcing.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"not-an-acquisition\">Not an acquisition<\/h2>\n\n\n\n<p>By structuring its relationship with Groq as an IP licensing deal, and hiring the engineers it is most interested in rather than buying their employer, Nvidia avoids taking on the GroqCloud service business just as it is reportedly stepping back from its own service business, DGX cloud, and <a href=\"https:\/\/www.theinformation.com\/articles\/nvidia-restructures-cloud-team-retreating-aws-competition\">restructuring it as an internal engineering service<\/a>. It could also escape much of the antitrust scrutiny that would have accompanied a full-on acquisition.<\/p>\n\n\n\n<p>Nvidia did not respond to questions about the names and roles of the former Groq executives it has hired.<\/p>\n\n\n\n<p>However, Groq&rsquo;s founder, <a href=\"https:\/\/www.linkedin.com\/in\/ross-jonathan\/\" target=\"_blank\" rel=\"noreferrer noopener\">Jonathan Ross<\/a>, reports on his LinkedIn profile that he is now chief software architect at Nvidia, while that of Groq&rsquo;s former president, <a href=\"https:\/\/www.linkedin.com\/in\/sundeepm\/\" target=\"_blank\" rel=\"noreferrer noopener\">Sunny Madra<\/a>, says he is now Nvidia&rsquo;s VP of hardware.<\/p>\n\n\n\n<p>What&rsquo;s left of Groq will be run by <a href=\"https:\/\/www.linkedin.com\/in\/sskedwards\/\" target=\"_blank\" rel=\"noreferrer noopener\">Simon Edwards<\/a>, formerly CFO at sales automation software vendor Conga. He joined Groq as CFO just three months ago.<\/p>\n\n\n\n<p>This article first appeared on <a href=\"https:\/\/www.networkworld.com\/article\/4112131\/nvidia-licenses-groqs-inferencing-chip-tech-and-hires-its-leaders.html\">Network World<\/a>.<\/p>\n\n\n\n<p><\/p>\n<\/div><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>Nvidia has licensed intellectual property from inferencing chip designer Groq, and hired away some of its senior executives, but stopped short of an outright acquisition. &ldquo;We&rsquo;ve taken a non-exclusive license to Groq&rsquo;s IP and have hired engineering talent from Groq&rsquo;s team to join us in our mission to provide world-leading accelerated computing technology,&rdquo; an Nvidia [&hellip;]<\/p>\n","protected":false},"author":2326,"featured_media":100071901,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"__idg_published_ids":[],"__idg_published_status":"draft","embargo_date":"","multi_title":"{\"titles\":{\"headline\":{\"value\":\"Nvidia licenses Groq&rsquo;s inferencing chip tech and hires its leaders\",\"additional\":{\"short_title\":\"Nvidia licenses Groq&rsquo;s inferencing chip tech and hires its leaders\",\"headline_subheadline\":\"This non-acquisition could help Nvidia diversify its supply chains and address new markets, while limiting antitrust scrutiny.\",\"headline_desc\":\"This non-acquisition could help Nvidia diversify its supply chains and address new markets, while limiting antitrust scrutiny.\"}},\"seo\":{\"value\":\"Nvidia licenses Groq&rsquo;s inferencing chip tech and hires its leaders\",\"additional\":{\"seo_desc\":\"This non-acquisition could help Nvidia diversify its supply chains and address new markets, while limiting antitrust scrutiny.\",\"seo_canonical_url\":\"https:\\\/\\\/www.networkworld.com\\\/article\\\/4112131\\\/nvidia-licenses-groqs-inferencing-chip-tech-and-hires-its-leaders.html\"}},\"social\":{\"value\":\"Nvidia licenses Groq&rsquo;s inferencing chip tech and hires its leaders\",\"additional\":{\"social_desc\":\"This non-acquisition could help Nvidia diversify its supply chains and address new markets, while limiting antitrust scrutiny.\"}}},\"subtitles\":[]}","old_id_in_onecms":"","_idg_updated_flag":false,"_idg_updated_date":"","hreflang_xdefault":0,"content_type":"News","suppress_html_meta":"{}","byline":"","featured_video_id":0,"supress_floating_video":false,"prevent_index":0,"has_duration":0,"teaser_paragraphs":"","is_translated_post":0,"idg_original_post_id":0,"idg_translated_post_ids":[],"idg_original_post_publication":"","idg_original_post_language":"","idg_original_post_brand":"","reviews":"","suppress_monetization":"{}","is_premium":0,"external_post_link":"","suppress_fake_sidebar":"{}","first_published_date":"2025-12-30T15:23:25+01:00","hide_featured_image_for_post":false,"post_featured_image_nocaption":true,"post_featured_image_caption":"","automatic_content_time":4,"manual_content_time":0,"most_popular_author":true,"more_from_author":true,"footnotes":""},"categories":[1885,1993,1959,1996,2888],"tags":[],"languages":[21],"editions":[12],"publication":[9,10],"territory":[],"story_types":[32],"article_type":[],"sponsorships":[],"blogs":[],"podcast_series":[],"origin":[7179],"coauthors":[6811],"class_list":{"0":"post-4112137","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"category-computer-components","9":"category-computers-and-peripherals","10":"category-cpus-and-processors","11":"category-generative-ai","12":"languages-en","13":"editions-global","14":"publication-computerworld","15":"publication-us-default","16":"story_types-news","17":"origin-wp"},"jetpack_featured_media_url":"https:\/\/www.computerworld.com\/wp-content\/uploads\/2026\/01\/4112137-0-45260400-1767619916-Groq.jpg?quality=50&strip=all","eyebrow":{"eyebrow":"news","eyebrow_style":"default","eyebrow_feed_title":"news","eyebrow_feed_style":"default"},"review_score":null,"article_type_name":"","author_name":"Peter Sayer","author_meta":[{"authorID":2326,"name":"Peter Sayer","url":"https:\/\/www.computerworld.com\/profile\/peter-sayer\/","img":{"media_id":100072028,"full":"https:\/\/www.computerworld.com\/wp-content\/uploads\/2026\/01\/2326-0-65030300-1767785153-author_photo_Peter-Sayer_1749557570.jpg?quality=50&strip=all"},"defaultUrl":"https:\/\/secure.gravatar.com\/avatar\/d5bfe75aa7407d6b5927045f6054940138cc0c1304a6c6e29bea19bf8c670480?s=96&d=mm&r=g","profileImage":"<img data-hero alt=\"Peter Sayer\" src=\"https:\/\/www.computerworld.com\/wp-content\/uploads\/2026\/01\/2326-0-65030300-1767785153-author_photo_Peter-Sayer_1749557570.jpg?quality=50&#038;strip=all&#038;w=250\" class=\"author_photo\" height=\"250\" width=\"250\" \/>","job_title":"Executive Editor, News"}],"multiple_name":"Peter Sayer","_embedded":"Peter Sayer","_links":{"self":[{"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/posts\/4112137","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/users\/2326"}],"replies":[{"embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/comments?post=4112137"}],"version-history":[{"count":0,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/posts\/4112137\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/media\/100071901"}],"wp:attachment":[{"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/media?parent=4112137"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/categories?post=4112137"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/tags?post=4112137"},{"taxonomy":"languages","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/languages?post=4112137"},{"taxonomy":"editions","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/editions?post=4112137"},{"taxonomy":"publication","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/publication?post=4112137"},{"taxonomy":"territory","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/territory?post=4112137"},{"taxonomy":"story_types","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/story_types?post=4112137"},{"taxonomy":"article_type","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/article_type?post=4112137"},{"taxonomy":"sponsorships","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/sponsorships?post=4112137"},{"taxonomy":"blogs","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/blogs?post=4112137"},{"taxonomy":"podcast_series","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/podcast_series?post=4112137"},{"taxonomy":"origin","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/origin?post=4112137"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.computerworld.com\/wp-json\/wp\/v2\/coauthors?post=4112137"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}