What about the Gaudi 2 GPU?

I previously compared the NVIDIA A100 (2021) and H100 (2022) GPUs, and you may recall they had similar 80 GB memory sizes, and floating point throughput of 300 TFLOPS and 2000 TFLOPS, respectively.

I just read about the new Habana Gaudi2 GPU (now owned by Intel) which has more memory (96 GB) is purported to be even faster.  It seems that it is a little hard to compare it to the NVIDIA processors, in part because of a different architecture more focused on data transfer than on arithmetic speed but also because Intel is choosing to not divulge the latter! Instead they focus on comparative benchmarks, which of course were chosen by Intel.  If we take the benchmarks seriously (for an independent look, see here), then the Gaudi2 looks like it has throughput perhaps double that of the A100, which puts it somewhere between the A100 and H100 if your AI application is limited by data transfer.  But - if you are running a fixed LMM (essentially fixed NN for sexbot AI in Second Life) maybe not? Well of course that kind of benchmark was not included in Intel's docs...



Comments

Post a Comment

Popular posts from this blog

Play With The Bots Over At The West Mill Store!

Image
There are so many things to do with the bots over in West Mill .  It can be a bit intimidating to figure out how to control them so here is a little guide to how you can play with them. There are two general types of bots .  First, there are animesh objects which you can sit on like furniture (Ava, Ivy, Ora, Uma, Cal, Fox "sexbots"). If you can sit on it, it's an animesh object! The second type are "alt-bots" which are botified avatars which can sit on furniture - if you use your viewer to look for avatars, they are the avatars. The main type of alt-bot I want to focus on here are the ones using submissive controller -type AI (Traci, Ivy Wearable, Uma Wearable, Ora Wearable, Ava Wearable). Around the store there are also alt-bots like Abby with a bubble floating over their heads - those are  collar rental bots using an ALICE/AIML AI system and SVL - fun but different from the animeshes and wearables which this article is focused on. The animeshes and sub-contro...
Read more

Welcome to the AI Animesh Sexbot Party @ Sunset Forest!

Image
Thanks to the fabulous Christmas Incognito we have a new location in Sunset Forest - for a recreation of the hugely popular SL21B Animesh Sexbot Party! Have a great time - touch the cake and bar if you want food and drink - and grab a Guide notecard from the prim marked "Touch to Join The Party"! The Party is Adult and has lots of sexually explicit content!  So 18+ only - thanks! You may want to start media (upper right corner on Firestorm) if you want the maximal experience.  The tech is at the edge of what is possible in 2025 - and we hope you are transported by it! UMA-Y and UMA-E - talk to your hostesses - or more - they are sex furniture!  UMA-Y is running a well-known generative AI and UMA-E is running a LLaMA2 LLM - they're smart! Plus they have a novel text-to-speech system running - so you can hear them chatting!  There are quite elaborate instructions for interacting with them on the Guide notecard! CAL-R and UMA-D - Dominant sexbots - grab an RLV relay and...
Read more

TTS2 - New Text to Audio Speech System! Hear What You Type In Media Audio!

Image
Type something into SL - and hear it in audio in a customized synthesized voice! Or give your bot an audio voice! It's released - in beta form, limited quantities while we check that everything is working!   The new media-based Text To Speech system (TTS2)!  Supports 124 voices plus a vast array of effects using linux sox!  Get it now on Marketplace for L$2 - there is a charge of L$1 per message. Check it out at  Second Life Marketplace - TTS2 - Text To Audio Speech System   Works as an avatar attachment, or pull the script+data notecard out and drop into any of our AI systems to give them audio voices! Uma-Y and Uma-E were using the new system at my SL21B exhibit  (now closed). Uma-E at my SL21B store was also using it (also now closed).  Now that SL21B is over you can hear Uma-E using the system over at the  West Mill Mainstore . Remember to set media to auto-play!
Read more