Pinchflat

128GB with 200GbE NVIDIA DGX Spark is GREAT for Local AI

Media Tasks
Actions

Raw Attributes

Source: ServeTheHome
  • playlist_index: 6
  • uuid: 2913fc58-1061-41fc-b9cb-e3835629f988
  • livestream: false
  • source_id: 12
  • upload_date_index: 99
  • metadata_filepath:
  • description: The NVIDIA DGX Spark with 128GB of LPDDR5X memory, a 20-core Arm CPU, Blackwell GPU, 200GbE RDMA NVIDIA ConnectX-7 networking, 10GbE, and more is great. This is going to be THE hotness for running local AI models in a sub 200W envelope for the entire system per node. STH Main Site Article: https://www.servethehome.com/nvidia-dgx-spark-review-the-gb10-machine-is-so-freaking-cool/ Substack: https://axautikgroupllc.substack.com/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join Professional Users Substack: https://axautikgroupllc.substack.com/ ---------------------------------------------------------------------- Where to Find The Unit We Purchased Note we may earn a small commission if you use these links to purchase a product through them. ---------------------------------------------------------------------- STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/ ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter: https://twitter.com/ServeTheHome Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/ Follow on Facebook: https://www.facebook.com/ServeTheHome/ Follow on Instagram: https://www.instagram.com/servethehome/ ---------------------------------------------------------------------- Other STH Content Mentioned in this Video ---------------------------------------------------------------------- - MikroTik CRS812 DDQ Video: https://youtu.be/rX46MLBOIok - MikroTik CRS812 DDQ: https://www.servethehome.com/mikrotik-crs812-ddq-400gbe-switch-launched-crs812-8ds-2dq-2ddq-marvell/ - Dell Pro Max with GB10: https://www.servethehome.com/dell-pro-max-with-gb10-unboxing-this-nvidia-gb10-arm-blackwell-ai-workstation/ - Dell Pro Max with GB10 short on the @STHLabs channel: https://youtube.com/shorts/zkc1OEOFMus ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction to the NVIDIA DGX Spark 01:06 NVIDIA GB10 Hardware Overview 06:35 200GbE RDMA Networking Setups 10:28 Setup and Power Consumption 15:17 Software, NVIDIA Sync with Cursor and Open WebUI Ollama Performance 18:41 Key Lessons Learned and Who This is For
  • id: 14370
  • media_downloaded_at:
  • nfo_filepath:
  • inserted_at: 2025-12-06T04:23:55Z
  • short_form_content: false
  • tasks:
  • updated_at: 2025-12-06T04:23:55Z
  • thumbnail_filepath:
  • duration_seconds: 1340
  • media_id: rKOoOmIpK3I
  • prevent_download: false
  • predicted_media_filepath: /downloads/shows/ServeTheHome/Season 2025/s2025e101400 - 128GB with 200GbE NVIDIA DGX Spark is GREAT for Local AI.mkv
  • uploaded_at: 2025-10-14T16:50:19Z
  • last_error:
  • title: 128GB with 200GbE NVIDIA DGX Spark is GREAT for Local AI
  • original_url: https://www.youtube.com/watch?v=rKOoOmIpK3I
  • prevent_culling: false
  • culled_at:
  • media_redownloaded_at:
  • matching_search_term:
  • media_size_bytes:
  • subtitle_filepaths:
  • media_filepath:

Nothing Here!