Nvidia reveals first AI platform for edge devices
Nvidia EGX brings real-time AI to the edge
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
In an effort to help bringartificial intelligenceto edge devices,Nvidiahas announced its newNvidia EGXplatform that has the ability to understand and act on data in real time without having to send it to the cloud or data center first.
Up until now, AI algorithms were so complex that they required powerful machines to run them in cloud data centers. However, this required a great deal of bandwidth and resulted in higher latency which is whyNvidiaand other hardware manufacturers have been trying to bring AI to the edge of the network instead.
Ideally AI should be run where data is created whether that be in retail stores, manufacturing facilities or warehouses.
Nvidia’s entrance to the AI edge market makes a great deal of sense as its graphics processing units are known for how well they can handle AI with the Tesla V100 being used for deep learning and the Quadro GV100 creating realistic images in real time using ray tracing.
Nvidia EGX
One of the best aspects of Nvidia’s new EGX platform is the fact that it is scalable and can be used in a number of configurations.
For instance, EGX starts with the tiny Nvidia Jetson Nano which can provide one-half trillion operations per second (TOPS) with just a few watts for tasks such as image recognition and spans all the way to a rack of Nvidia T4 servers to deliver over 10,000 TOPS for real-time speech recognition and other real-time AI tasks.
Vice president and general manager of Enterprise and Edge Computing at Nvidia, Bob Pette explained how the EGX platform was designed to meet the needs of enterprise customers in apress release, saying:
Are you a pro? Subscribe to our newsletter
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
“Enterprises demand more powerful computing at the edge to process their oceans of raw data — streaming in from countless interactions with customers and facilities — to make rapid, AI-enhanced decisions that can drive their business. A scalable platform like NVIDIA EGX allows them to easily deploy systems to meet their needs on premises, in the cloud or both.”
The platform also integrates security, storage and networking technologies fromMellanoxwhich Nvidia plans to acquire by the end of the year.
Nvidia is working with 13 different server manufacturers to sell its EGX platform including Cisco,Dell-EMC, HPE,Lenovoand others. EGX is also compatible with AI applications running on AWS andMicrosoftAzure and the platform can even connect to IoT services from both providers.
ViaSilicon Angle
After working with the TechRadar Pro team for the last several years, Anthony is now the security and networking editor at Tom’s Guide where he covers everything from data breaches and ransomware gangs to the best way to cover your whole home or business with Wi-Fi. When not writing, you can find him tinkering with PCs and game consoles, managing cables and upgrading his smart home.
New fanless cooling technology enhances energy efficiency for AI workloads by achieving a 90% reduction in cooling power consumption
Samsung plans record-breaking 400-layer NAND chip that could be key to breaking 200TB barrier for ultra large capacity AI hyperscaler SSDs
NYT Strands today — hints, answers and spangram for Sunday, November 10 (game #252)
