Scale AI Applications to the Data Center and Cloud with NVIDIA Nsight Systems

NVIDIA2024-03-18

NVIDIA

1K views|5 months ago

💫 Short Summary

Insight Systems is adapting to the challenges of AI applications by providing features for microservices, GPU utilization, and networking. They now offer multi-node heat maps, enhanced profiling for Kubernetes and Docker, and remote viewing of reports. This evolution supports building applications in the modern landscape of computing.

✨ Highlights

📊 Transcript

✦

Evolution of Insight Systems in AI Applications Scaling.

01:07

New features introduced to assist application developers with microservices, including recipes for GPU utilization, Cuda kernel time, and networking communications.

Multi-node heat maps now generated to show congestion and throughput, with enhanced profiling support for container systems such as Kubernetes and Docker.

Remote gooey streaming containers enable remote viewing of reports, with integration with Jupyter Lab expanding further.

Insight systems evolving to support building applications in the new landscape of computing, focusing on GPU acceleration and AI scaling.

00:02as Cloud applications continue to ramp

00:04up their requests per second and high

00:06performance Computing applications

00:08increase their working set sizes the

00:09demand for scalable Solutions is more

00:12pressing than ever Insight systems is

00:14nvidia's comprehensive performance

00:16analysis tool today Insight systems is

00:19evolving to meet the challenges of AI

00:21applications scaling out across data

00:23centers and clouds we're excited to

00:25introduce new features aimed at

00:27assisting application developers with

00:28microservices Insight systems multi-node

00:31performance analysis is enabled by

00:33scripts called recipes that triage data

00:36to help you see and understand

00:38application

00:39performance a recipe's output is

00:42visualized with jupyter notebook

00:43integration this guides you to where

00:45optimization is needed and what the

00:47likely culprit

00:48is recipes help you inspect things like

00:51GPU

00:52utilization Cuda kernel time and now

00:56networking Communications are a critical

00:59part of scaling out applications so

01:01we're introducing new analysis recipes

01:03designed to help users understand how

01:05compute cold spots relate to

01:07communication and sight systems can now

01:09generate multi- Noe heat maps to show

01:11infin van

01:14congestion infin van and ethernet

01:18throughput Envy link

01:22throughputs and overlapped compute and

01:26networking we've also enhanced profiling

01:28support for popular container systems

01:30like kubernetes and Docker this includes

01:33comprehensive support for CSP kubernetes

01:35services including from Amazon Azure

01:38Oracle and Google and to meet you where

01:41you are writing code server development

01:43is enabled by remote gooey streaming

01:45container this allows you to view

01:47reports remotely rather than needing to

01:49copy them back to your PC or

01:51laptop an integration with Jupiter

01:53software is expanding even further

01:55Insight systems now integrates with

01:57Jupiter lab allowing you to profile code

01:59within in individual cells you can also

02:01view textual results such as statistics

02:04directly in Jupiter

02:06lab timeline reports can launch the

02:08remote guey streaming container with a

02:10single click seamlessly opening in a new

02:12tab modern-day Computing is defined by

02:15GPU acceleration and AI scaling

02:18applications across multiple nodes and

02:20on cloud infrastructure is crucial to

02:22meeting these new demands Insight

02:24systems has evolved to help you build

02:26applications in the new landscape of

02:28computing whether on premise or in the

02:30cloud learn more and get started at

02:32developer. nvidia.com

🎥 Related Videos

What vaccinating vampire bats can teach us about pandemics | Daniel Streicker

a16z Podcast | Things Come Together -- Truths about Tech in Africa

2024 TSCRS Applications of anterior segments diagnostic instruments in cataract surgery

a16z Podcast | The Infrastructure of Total Health

The Robot Lawyer Resistance with Joshua Browder of DoNotPay

NES Controllers Explained

🔥 Recently Summarized Examples

The Hitler-Stalin Pact | Reflections Episode 9

Uncovering Corruption From Health "Experts" | Scott Carney

The Forgotten Geometry: A New Path to Unification

Joe Rogan Experience #2194 - Luis Elizondo

From Tesla to DNA: The Science of Scalar Waves - Dr. Sandra Rose Michael - Think Tank E44

Bitcoin Holders...Watch Out for Sept

View original video