Home Blog Page 377

Project Stargate: A $500-Billion AI Initiative for a Platform Shift

US President Announces Massive AI Initiative with OpenAI, SoftBank, and MGX

Joint Venture to Invest $500 Billion in AI Data Centers

US President Donald Trump announced a joint venture between OpenAI, Japanese conglomerate SoftBank Group, and Abu Dhabi’s AI-focused sovereign wealth fund MGX, to invest as much as $500 billion over multiple years in US data centers dedicated to artificial intelligence.

Major Tech Firms to Spend Heavily on AI

The funding, intended to provide "colossal" data centers of 500,000 square feet, comes on top of an enormous amount of capital spending planned by the largest tech firms. According to one Wall Street analyst, Jackson Ader of the KeyBanc Capital Markets brokerage, "Capital spending for the major hyperscalers" – that is, Amazon, Alphabet, Microsoft, Oracle, Meta, and Alibaba – "will be $286.5 billion in 2025, and $308.8 billion in 2026, after making some adjustments to consensus estimates."

Stargate Adds Fuel to AI Spending Narrative

While the initial $100 billion planned for Stargate is just a dollop on top of all that planned spending, it is still encouraging to Ader and others who have been forecasting high AI spending for years to come.

Analysts Weigh In

Numerous questions remain regarding the initiative. SoftBank’s Son is responsible for putting together the initial $100 billion, and it is not yet clear where that money will come from. In a note to clients, tech analyst Brad Zelnick of the investment bank Deutsche Bank noted that one big question is the "ownership and financial structure of the new joint venture, the sources and amount of committed funding already in place, plans for future funding, and how it will be accounted for within the financial results of each company."

Critics Weigh In

AI critic Gary Marcus weighed in on Substack, calling it an "AI catfight." "Elon thinks Sam is playing the same move that they once played together," when the two were forming OpenAI and had not yet produced money but were telling people they had. "He could be right," adds Marcus, "neither is known for absolute candor."

Conclusion

The Stargate initiative is a significant step forward in the development of artificial intelligence, with the potential to drive innovation and growth in the field. While there are many questions still to be answered, the joint venture between OpenAI, SoftBank, and MGX is a major win for the AI industry.

FAQs

Q: What is the Stargate initiative?
A: The Stargate initiative is a joint venture between OpenAI, SoftBank Group, and MGX to invest in US data centers dedicated to artificial intelligence.

Q: How much money is being invested in the Stargate initiative?
A: The initiative is expected to invest as much as $500 billion over multiple years.

Q: Who is involved in the Stargate initiative?
A: The initiative involves OpenAI, SoftBank Group, MGX, and other technology partners, including Oracle, Microsoft, ARM Holdings, and Nvidia.

Q: What is the purpose of the Stargate initiative?
A: The purpose of the Stargate initiative is to drive innovation and growth in the field of artificial intelligence.

Q: What are the potential benefits of the Stargate initiative?
A: The potential benefits of the Stargate initiative include driving innovation and growth in the field of artificial intelligence, creating new job opportunities, and increasing economic growth.

The Power of Java APIs

The Power of Java APIs in Software Development

The Revolution in Software Development

Application Programming Interfaces (APIs) have revolutionized the way developers design and build software, enabling seamless communication between different software components. Among the myriad of API ecosystems available, Java APIs have emerged as a game-changer in modern software development. Their robust features, wide adoption, and unmatched versatility make them indispensable in creating scalable, efficient, and innovative solutions. This article explores the transformative impact of Java APIs, examining their strengths, applications, and why they have become essential in today’s software industry.

The Power of APIs in Software Development

APIs are a set of definitions and protocols that allow applications to communicate with each other. They enable developers to leverage pre-existing functionalities without reinventing the wheel, thus speeding up development cycles and fostering innovation. By abstracting the complexities of underlying operations, APIs provide a simplified interface for developers to interact with complex systems.

Why Java APIs Are a Game-Changer

Platform Independence

One of Java’s core philosophies is "Write Once, Run Anywhere" (WORA). Java APIs uphold this principle by ensuring compatibility across different platforms. This platform independence allows developers to create applications that can run seamlessly on various devices and operating systems without requiring extensive modifications. For businesses, this translates to reduced development costs and increased reach.

For example, APIs like the Java Database Connectivity (JDBC) API allow developers to connect to any database—whether it’s MySQL, Oracle, or PostgreSQL—without worrying about platform-specific intricacies.

Extensive Library Ecosystem

The Java ecosystem boasts an extensive collection of APIs that cater to nearly every aspect of software development. Some of the most notable Java APIs include:

  • Java Collections Framework: Simplifies data structure manipulation with built-in classes for lists, maps, sets, and more.
  • Java Stream API: Introduced in Java 8, it allows for functional-style operations on collections, enabling efficient data processing.
  • JavaFX API: Empowers developers to create rich graphical user interfaces (GUIs) for desktop and mobile applications.
  • Java Servlet API: Facilitates the creation of dynamic web applications by handling HTTP requests and responses.

Scalability and Performance

Java APIs are designed to handle large-scale applications with ease. For instance, the Java Enterprise Edition (Java EE) APIs, now known as Jakarta EE, provide robust tools for building enterprise-grade solutions. These APIs support distributed computing, load balancing, and fault tolerance, ensuring applications can scale effortlessly as demand grows.

Security

Security is a critical aspect of modern software development, and Java APIs offer built-in mechanisms to safeguard applications. The Java Cryptography Architecture (JCA) and Java Secure Socket Extension (JSSE) provide tools for encryption, authentication, and secure communication. These APIs simplify the implementation of robust security features, making it easier for developers to comply with industry standards and protect sensitive data.

Integration with Emerging Technologies

Java APIs have kept pace with emerging technologies, ensuring developers can integrate cutting-edge features into their applications. For instance:

  • Machine Learning and AI: Libraries like Deeplearning4j and DL4J APIs enable developers to implement machine learning algorithms and neural networks in Java applications.
  • Cloud Computing: APIs like the Java Cloud Service SDK allow seamless integration with cloud platforms like AWS, Google Cloud, and Azure.
  • IoT: The Java ME Embedded API provides tools for developing applications on Internet of Things (IoT) devices.

Real-World Applications of Java APIs

Web Development

Java APIs like the Servlet API, JSP (JavaServer Pages), and Spring Framework are widely used in web development. These APIs provide powerful tools for creating dynamic, secure, and scalable web applications. For example, the Spring Web MVC framework simplifies the development of RESTful APIs, enabling seamless communication between front-end and back-end systems.

Mobile Applications

Although Android development has its own set of APIs, it is built on Java’s foundations. Developers use Java APIs alongside Android SDK to create feature-rich mobile applications. APIs like Retrofit and OkHttp are frequently employed for networking operations, while Room and SQLite APIs handle database management.

Enterprise Solutions

Java EE APIs, such as JPA (Java Persistence API) and EJB (Enterprise JavaBeans), are staples in enterprise software development. They enable businesses to build robust systems for resource planning, customer relationship management, and supply chain management.

Big Data and Analytics

Java APIs play a crucial role in processing and analyzing massive datasets. Tools like Apache Hadoop and Apache Spark, which are built in Java, provide APIs for distributed data processing. Additionally, the Java Stream API and libraries like Jackson are often used for data parsing and manipulation.

Cloud-Native Development

As cloud computing becomes the norm, Java APIs have adapted to support microservices and containerization. Frameworks like Spring Boot and APIs like Kubernetes Java Client facilitate the development and deployment of cloud-native applications, ensuring scalability and resilience.

Gaming and Multimedia

Java APIs like JavaFX and LWJGL (Lightweight Java Game Library) are popular in game development. They provide tools for creating immersive graphics, handling user input, and managing audio and video resources. For example, the game "Minecraft," one of the most popular games worldwide, was originally developed in Java.

Challenges and Future Prospects

While Java APIs offer numerous advantages, they are not without challenges. The learning curve for mastering Java APIs can be steep for beginners due to their extensive documentation and intricate configurations. Additionally, the rapid pace of technological advancements requires developers to stay updated with new APIs and best practices.

Despite these challenges, the future of Java APIs looks promising. The introduction of features like Project Loom, which aims to simplify concurrency in Java, and the continuous evolution of frameworks like Spring and Quarkus demonstrate Java’s commitment to staying relevant. Moreover, the growing demand for cross-platform solutions and cloud-native development ensures that Java APIs will remain a cornerstone of modern software engineering.

Conclusion

Java APIs have undeniably transformed the landscape of software development. Their platform independence, extensive library ecosystem, scalability, and adaptability to emerging technologies make them a game-changer for developers and businesses alike. From powering enterprise solutions and web applications to enabling cutting-edge innovations in AI and IoT, Java APIs are at the heart of countless technological advancements.

FAQs

Q: What is the main advantage of using Java APIs?
A: The main advantage of using Java APIs is their platform independence, which allows developers to create applications that can run seamlessly on various devices and operating systems.

Q: What are some popular Java APIs for web development?
A: Some popular Java APIs for web development include the Servlet API, JSP (JavaServer Pages), and Spring Framework.

Q: What is the Java Stream API?
A: The Java Stream API is a feature introduced in Java 8 that allows for functional-style operations on collections, enabling efficient data processing.

Q: What are some popular Java APIs for machine learning and AI?
A: Some popular Java APIs for machine learning and AI include Deeplearning4j and DL4J APIs.

Q: What is the difference between Java EE and Jakarta EE?
A: Java EE is the previous name for the Java Enterprise Edition, which has been renamed to Jakarta EE.

Google’s Gemini AI smart home controls are rolling out to everyone

0

Google Brings Smart Home Controls to Gemini

Google is expanding the capabilities of its Gemini app by introducing smart home controls, allowing users to manage their compatible devices with ease.

New Features and Improvements

The Google Home extension in the Gemini app is gaining a few new features, enabling users to adjust their smart lighting, thermostat, speakers, and other compatible devices as long as they’re connected to their Google account. The extension was first previewed in November and has now been rolled out to everyone.

Natural Language Control

With the Google Home extension, users can use natural language to control their smart home devices when interacting with Gemini. For example, saying “The sun is too bright in the living room” can close smart blinds. Additionally, Gemini can now carry out multiple requests, such as “Turn the armchair light on too, but dim the kitchen lamp.” Users can also ask Gemini about the status of their devices, such as whether they’ve left their porch light on.

Lock Screen Control and More

Google will also allow users to control “non-sensitive” smart home devices, like lights, from their phone’s lock screen. Other updates include the ability to adjust the volume, pause, and resume media on smart speakers, displays, and TVs within the Gemini app, as well as an updated thermostat control design that matches the one inside Google Home. Gemini will also automatically open the Google Home app for security-related actions for cameras and locks.

Availability and Rollout

The launch of the Google Home extension follows a big update to Gemini, which lets it perform more complex tasks across multiple apps. Users can try out the integration for themselves by signing into Gemini with the same account they use for Home and turning on the Google Home extension. The feature is launching today but will be rolling out “over the coming weeks.”

Conclusion

The addition of smart home controls to Gemini makes it a more comprehensive and convenient hub for managing users’ devices. With its natural language control and expanded capabilities, Gemini is poised to become an even more essential part of users’ daily routines.

Frequently Asked Questions

Q: What devices can I control with the Google Home extension in Gemini?
A: You can control smart lighting, thermostat, speakers, and other compatible devices as long as they’re connected to your Google account.

Q: Can I use natural language to control my smart home devices with Gemini?
A: Yes, you can use natural language to control your smart home devices when interacting with Gemini.

Q: Can I control multiple devices at once with Gemini?
A: Yes, Gemini can now carry out multiple requests, such as “Turn the armchair light on too, but dim the kitchen lamp.”

Q: Will I be able to control my smart home devices from my phone’s lock screen?
A: Yes, you will be able to control “non-sensitive” smart home devices, like lights, from your phone’s lock screen.

Q: When will the Google Home extension be available in Gemini?
A: The feature is launching today but will be rolling out “over the coming weeks.”

Unlocking a Brighter Future with AI

Here’s the rewritten text:

The future of agriculture is expected to transform with the rising use of advanced technologies like next-generation artificial intelligence (AI), which has vast potential to lift crop yields even as climate change exacerbates erratic weather patterns globally.

The future of agriculture

The world’s population growth is expected to continue, prompting a need to increase agricultural efficiency and output in the face of unpredictable weather due to climate change. According to Professor Patrick Schnable, predicting major losses in crop yields attributed to climate change, a solution lies in increasing agricultural yields sustainably. The UN Food and Agriculture Organization shares this view, stating that smart farm management methods could offset 30% agricultural emissions.

Furthermore, water allocation and usage present significant challenges given the ongoing concerns about drought. AI-powered research suggests that precise irrigation methods leveraging data analysis might significantly reduce farmers’ water footprints.

Technology and AI developments have enabled breakthroughs in food production. Enhanced crop yields by precision agriculture empower farmers to select areas for fertilization, minimizing waste. New farming methods utilize drones, smart sensors, tractor-mounted equipment for monitoring and optimized crop growth to maximize water quality.

From agriculture to the environment

Addressing the concerns of environmental damage, AI models can monitor wildlife habitats and aquatic ecosystems. Effective conservation efforts via AI can restore damaged habitats or predict threats enabling timely intervention before irreversible damage transpires.

Drones equipped with AI software might identify areas crucial for wildlife regeneration, enhancing understanding of the ever-changing environment in real-time scenarios.

Improving healthcare, conservation, and agriculture with technology

Drone-assisted conservation and pollution monitoring

Research indicates AI-controlled drones could surveil polluted urban areas, generating detailed reports from collected data analysis. In forests, drones utilize AI for optimal tree growth or monitoring for climate change. Air quality monitoring helps authorities detect & mitigate pollution patterns.

Transforming healthcare care

AI patterns in patient diagnosis enable targeted remedies, while enhanced medical research might accelerate treatments discoveries. Personalizing patient care benefits from AI assistance, addressing tailored treatments.

  1. How beneficial is AI towards the future?

AI is being explored in crucial sectors such agriculture, healthcare & conservation, boosting efficiency and crop yields. Enhancing decision- making with analytical insights will address climate change as well.

Will AI create greater disparities?

Partnerships where AI complements human soft-skills & training can reduce job losses & training needs, preserving employment.

What is required for AI-enabled healthcare? Patient data accessibility + trust & reliable data storage ensuring accurate diagnoses.
What safeguards measure is in play for AI developments?

Trust establishment through AI "backward integration to deliver the problem solution" guarantees AI does not amplify nefarious intent. Monitoring AI-generated inputs for responsible ethics ensures society keeps trust in responsible AI usage for societal betterment.

Will smart sensors for IoT applications play important roles in ensuring sustainability?

Enabling IoT enabled smart sensors streamline data transmission monitoring crop health growth, energy consumptions, precision irrigation & management, making resources more efficient without compromising on quantity.

Data accuracy, sensor calibration & frequency of updates significantly impact smart farm management, allowing for better quality & reduced post-harvest losses.

These questions will explore the importance & potential benefits through AI-assistance in addressing significant global concerns!

Conclusion and Next Steps:

NVIDIA NIM Microservices on Kubernetes Autoscaling

0

Prerequisites

To follow along with this tutorial, you need the following list of prerequisites:

  • An NVIDIA AI Enterprise license
  • A Kubernetes cluster version 1.29 or later (we used DGX Cloud Clusters)
  • Admin access to the Kubernetes cluster
  • Kubernetes CLI tool kubectl installed
  • HELM CLI installed

Setting up a Kubernetes cluster

The first step in this tutorial is to set up your Kubernetes cluster with the appropriate components to enable metric scraping and availability to the Kubernetes HPA service. This requires the following components:

  • Kubernetes Metrics Server
  • Prometheus
  • Prometheus Adapter
  • Grafana

Kubernetes Metrics Server

Metrics Server is responsible for scraping resource metrics from Kubelets and exposes them in Kubernetes API Server through the Metrics API. This is used by both the Horizontal Pod Autoscaler and the kubectl top command.

To install the Kubernetes Metric Server, use Helm.

helm repo add metrics-server https://kubernetes-sigs.github.io/metrics-server/
helm upgrade --install metrics-server metrics-server/metrics-server

Prometheus and Grafana

Prometheus and Grafana are well-known tools for scraping metrics from pods and creating dashboards. To install Prometheus and Grafana, use the kube-prometheus-stack Helm chart that includes many different components.

helm repo add prometheus-community https://prometheus-community.github.io/helm-charts
helm repo update
helm install [RELEASE_NAME] prometheus-community/kube-prometheus-stack

The Prometheus adapter exposes the scraped metrics from Prometheus in the Kubernetes apiserver through Metrics API. This enables HPA to use custom metrics from pods to make scaling strategies.

helm install prometheus-community/prometheus-adapter -n

Make sure that the Prometheus adaptor is pointing to the correct Prometheus service endpoint. In this case, I had to edit the deployment and correct the URL.

kubectl edit deployment prom-adapter-prometheus-adapter -n prometheus
spec:
  affinity: {}
  containers:
  - args:
    - /adapter
    - --secure-port=6443
    - --cert-dir=/tmp/cert
    - --prometheus-url=http://prometheus-prometheus.prometheus.svc:9090
    - --metrics-relist-interval=1m
    - --v=4
    - --config=/etc/adapter/config.yaml
    image: registry.k8s.io/prometheus-adapter/prometheus-adapter:v0.12.0

Deploying a NIM microservice

In this tutorial, you use NIM for LLMs as a microservice to scale, specifically using model meta/llama-3.1-8b-instruct.

After deployment, you should note the service name and namespace of your NIM for LLMs microservice, as this will be used in many commands.

NIM for LLMs already exposes a Prometheus endpoint with many interesting metrics. To see the endpoint, use the following commands:

kubectl -n <namespace> port-forward svc/<service_name> 8080

From a browser, go to localhost:8080/metrics and look for the specific metric named gpu_cache_usage_perc. In this post, you use this metric as a basis for autoscaling. This metric shows the percent utilization of the KV cache and is reported by the vLLM stack.

Creating HPA

Now that you have observed the impact of concurrency on KV cache utilization, you can create the HPA resource. Create the HPA resource to scale based on the gpu_cache_usage_perc metric:

apiVersion: autoscaling/v2
kind: HorizontalPodAutoscaler
metadata:
  name: gpu-hpa-cache
spec:
  scaleTargetRef:
    apiVersion: apps/v1
    kind: Deployment
    name: meta-llama3-8b
  minReplicas: 1
  maxReplicas: 10
  metrics:
  - type: Pods
    pods:
      metric:
        name: gpu_cache_usage_perc
      target:
        type: AverageValue
        averageValue: 100m
kubectl create -f hpa-gpu-cache.yaml -n <namespace>

Run genai-perf at different concurrencies (10, 100, 200) and watch the HPA metric increase:

NAME            REFERENCE                   TARGETS   MINPODS   MAXPODS   REPLICAS   AGE
gpu-hpa-cache   Deployment/meta-llama3-8b   9m/100m   1         10        1          3m37s

Check the number of pods and you should see that autoscaling added two new pods:

NAME                                       READY   STATUS              RESTARTS      AGE
meta-llama3-8b-5c6ddbbfb5-85p6c            1/1     Running             0             25s
meta-llama3-8b-5c6ddbbfb5-dp2mv            1/1     Running             0             146m
meta-llama3-8b-5c6ddbbfb5-sf85v            1/1     Running             0             26s

Conclusion

In this post, we described how to set up your Kubernetes cluster to scale on custom metrics and showed how you can scale a NIM for LLMs based on the KV cache utilization parameter.

There are many advanced areas to explore further in this topic. For example, many other metrics could also be considered for scaling, such as request latency, request throughput, and GPU compute utilization. You can scale on multiple metrics in one HPA resource and scale accordingly.

Another area of interest is the ability to create new metrics using Prometheus Query Language (PromQL) and add them to the configmap of the Prometheus adapter so that HPA can scale.

FAQs

Q: What is the purpose of the Kubernetes Metrics Server?
A: The Kubernetes Metrics Server is responsible for scraping resource metrics from Kubelets and exposes them in Kubernetes API Server through the Metrics API.

Q: What is Prometheus and Grafana?
A: Prometheus and Grafana are well-known tools for scraping metrics from pods and creating dashboards.

Q: How do I create a new metric using Prometheus Query Language (PromQL)?
A: You can create a new metric using Prometheus Query Language (PromQL) and add it to the configmap of the Prometheus adapter so that HPA can scale.

Q: What are some advanced areas to explore further in this topic?
A: Some advanced areas to explore further in this topic include scaling on multiple metrics in one HPA resource, scaling based on request latency, request throughput, and GPU compute utilization, and creating new metrics using Prometheus Query Language (PromQL).

European Power Grid Under Threat

Like Dominoes Falling Over

Photovoltaic system disconnect.

For ease, they used a Flipper Zero device they had configured to send the proper telegram to the photovoltaic system. They did this after discovering that the Flipper Zero’s RFID reading mode could be used to send signals modulated with frequency-shift keying to receivers within a one-meter distance.

Credit: Positive Security

With confidence that an attacker could send unauthorized Radio Ripple Control telegrams that instructed real electrical systems connected to the grid, the researchers got to wondering: What’s the maximum amount of damage a malicious actor—most likely one working for a nation-state—could inflict?

The Maximum Amount of Damage

The researchers surveyed the grid to measure the capacity of power that small- and medium-sized renewable facilities could feed into the grid. They arrived at the estimate of 40 GW. Combined with the 20 GW of load they theoretically can add, that amounted to an unbalanced capacity of 60 GW, enough to power roughly all of Germany. They posited that a sudden change that added or ditched that amount of electricity from the grid all at once could create enough instability to take it down entirely.

Like Dominoes Falling Over

In a published summary of last month’s presentation, the researchers explained their thinking behind the estimate:

To understand, we need to look at the grid frequency. It’s 50 hertz, and it should always stay there.

  • If it reaches 50.2 hertz or more, interventions are triggered to reduce the supply. For example, using the technology we’re discussing today to turn off solar parks.
  • If the frequency drops below 49.8 hertz, other interventions occur, such as activating energy reserves or disconnecting industries that have contractually agreed to this happening. Also, the first hardware fails as it happened at Vienna airport.
  • If the frequency reaches 49 Hz or less, automated stepwise load shedding begins, up to 50% at 48.5 Hz. That might sound a bit technical and sober, but what it means for the European grid is over 200 million people without power.
  • At 47.5 Hz, power plants disconnect from the grid to protect themselves from damage. At that point, the grid needs to be rebuilt from scratch.

In theory, with a fully loaded grid at 300 GW, creating a 1 Hz change to reach this private load-shedding threshold requires an imbalance of 18 GW. However, such a large imbalance—though not even that massive compared to the 60 GW estimate—has never been seen.

In practice, one of the most recent incidents was in 2021, when approximately 3 GW of power were unexpectedly lost in Poland, causing the grid frequency to drop by 0.16 hertz. What this demonstrates is that the grid hasn’t yet faced such a significant imbalance.

Power Transfer

But if we start talking about imbalances of 18 GW, or 60 GW, or even more when considering other countries, there’s an additional issue besides the theoretical effect on grid frequency. That issue is power transfer.

If a significant amount of power is missing in one region, it must be transferred there over power lines that could become overloaded. These lines might then shut off to prevent damage, which could overload other lines, causing them to shut off too.

Such a domino effect—or cascade—happened in 2006, when a power line was shut off to accommodate a cruise ship transport. The planning wasn’t thorough, and a cascade of failures followed. So, the theoretical limits of the grid don’t fully capture the potential for much larger disruptions.

Send Malicious Telegrams to Select FREs

There are enough obstacles to make triggering such a catastrophic disruption challenging at best (Bräunlein’s and Melette’s assessment) or doubtful to unlikely (the assessment of an outside grid expert). The researchers noted three key requirements for such an attack.

Conclusion

Taking all of that into account, it’s clear there is enough power under radio control to cause serious trouble.

FAQs

Q: What is Radio Ripple Control?
A: Radio Ripple Control is a technology used to control and manage renewable energy sources connected to the grid.

Q: How can malicious actors use Radio Ripple Control?
A: Malicious actors can use Radio Ripple Control to send unauthorized telegrams to select FREs (Frequency Response Elements) that control real electric systems in their lab.

Q: What is the maximum amount of damage a malicious actor could inflict?
A: The researchers estimate that a malicious actor could create an imbalance of 60 GW, enough to power roughly all of Germany, and potentially cause widespread disruptions to the grid.

Q: Is it possible to trigger such a catastrophic disruption?
A: The researchers note that there are enough obstacles to make triggering such a disruption challenging at best, or doubtful to unlikely.

DeepSeek Tackles Tech Giants with Its AI Competence

0

The Rise of DeepSeek: A New Era in A.I. Technology

A New Challenger in the A.I. Landscape

The day after Christmas, a small Chinese start-up called DeepSeek unveiled a new A.I. system that could match the capabilities of cutting-edge chatbots from companies like OpenAI and Google. This achievement would have been remarkable on its own, but the team behind the system, called DeepSeek-V3, took it a step further by revealing that they used only a fraction of the highly specialized computer chips that leading A.I. companies relied on to train their systems.

The Chip Conundrum

These chips are at the center of a tense technological competition between the United States and China. As the U.S. government works to maintain its lead in the global A.I. race, it is trying to limit the number of powerful chips, like those made by Silicon Valley firm Nvidia, that can be sold to China and other rivals. However, the performance of the DeepSeek model raises questions about the unintended consequences of the American government’s trade restrictions. The controls have forced researchers in China to get creative with a wide range of tools that are freely available on the internet.

The Birth of a New Era

The DeepSeek chatbot answered questions, solved logic problems, and wrote its own computer programs as capably as anything already on the market, according to the benchmark tests that American A.I. companies have been using. And it was created on the cheap, challenging the prevailing idea that only the tech industry’s biggest companies – all of them based in the United States – could afford to make the most advanced A.I. systems. The Chinese engineers said they needed only about $6 million in raw computing power to build their new system. That is about 10 times less than the tech giant Meta spent building its latest A.I. technology.

The Rise of Open Source Technology

The world’s leading A.I. companies train their chatbots using supercomputers that use as many as 16,000 chips, if not more. DeepSeek’s engineers, on the other hand, said they needed only about 2,000 specialized computer chips from Nvidia. The constraints on chips in China forced the DeepSeek engineers to "train it more efficiently so it could still be competitive," said Jeffrey Ding, an assistant professor at George Washington University who specializes in emerging technology and international relations.

The Global Consequences

The U.S. government has tried to keep advanced chips out of the hands of Chinese companies over concerns they could be used for military purposes. In response, some firms in China have stockpiled thousands of chips, while others sourced them from a thriving underground marketplace of smugglers.

Conclusion

DeepSeek’s achievement is a testament to the power of innovation and the potential for A.I. to democratize access to advanced technologies. As the world becomes increasingly reliant on A.I. solutions, it is crucial that we recognize the importance of open source technology and the role it can play in accelerating its development.

Frequently Asked Questions

Q: What is DeepSeek?
A: DeepSeek is a new A.I. system developed by a small Chinese start-up that can match the capabilities of cutting-edge chatbots from companies like OpenAI and Google.

Q: How did DeepSeek achieve this feat?
A: DeepSeek’s engineers used a fraction of the highly specialized computer chips that leading A.I. companies relied on to train their systems, forcing them to "train it more efficiently so it could still be competitive."

Q: What are the implications of DeepSeek’s achievement?
A: The performance of the DeepSeek model raises questions about the unintended consequences of the American government’s trade restrictions and highlights the potential for A.I. to democratize access to advanced technologies.

Q: What is the significance of open source technology in A.I.?
A: Open source technology has the potential to accelerate the development of A.I. solutions and make them more accessible to a wider range of users and organizations.

Operator for ChatGPT

0

Introducing Operator: OpenAI’s AI Agent for Automating Online Tasks

What is Operator?

OpenAI has launched a new tool called Operator, an AI agent that uses its artificial intelligence to operate a web browser to book trips, buy groceries, hunt for bargains, and perform many other online chores. This tool is designed to automate many day-to-day tasks and workday errands, making it easier for users to manage their daily routines.

How does it work?

Operator relies on an AI model trained on both text and images to interpret commands and figure out how to use a web browser to execute them. This means that it can understand complex, multi-step workflows and perform tasks that would normally require human intervention.

Potential Impact

According to OpenAI, this technology has the potential to significantly impact people’s productivity, but also the quality of work they are able to accomplish. "AI is evolving from a tool that could answer your questions to one that is also able to take action in the world," says Peter Welinder, VP of Product at OpenAI.

Risks and Challenges

However, OpenAI acknowledges that giving ChatGPT access to a web browser introduces new risks. It says that Operator may sometimes misbehave and that it has implemented various new safeguards to prevent this. The company is also planning to extend Operator’s capabilities gradually and is designing it to ask for confirmations before taking steps that might be irreversible.

System Cards and Safety Challenges

OpenAI has also released a new "system card" outlining the potential problems that may arise with Operator, including the risk of it misunderstanding commands, diverging from what a user asks, or being misused by users. Yash Kumar, product and engineering lead for OpenAI’s Computer Using Agent, notes that this technology also poses significant safety challenges. "Because your attack vector area and your risk vector area increase quite significantly," he says.

Availability and Pricing

Operator will initially be available as a "research preview" for ChatGPT users with a Pro account, which costs a hefty $200 per month. OpenAI plans to expand access while rolling out the tool slowly, as it will inevitably make some mistakes along the way.

Demonstrations

In several demonstrations, Operator showed the potential for AI to take on a more active role as a web helper. The tool features a remote web browser and a chat window for communicating with a user. In one demonstration, Operator was asked to book an Amtrak train trip from New Haven, Connecticut, to Washington, DC. It successfully went to the right website and entered the necessary information correctly to bring up the timetable, then asked for further instruction.

Conclusion

Operator is a significant step forward in the evolution of AI technology, with the potential to revolutionize the way we use the internet. However, it also raises important questions about safety and risk. As OpenAI continues to develop and refine this technology, it will be important to monitor its progress and ensure that it is used responsibly.

Frequently Asked Questions

Q: What is Operator?
A: Operator is an AI agent that uses its artificial intelligence to operate a web browser to book trips, buy groceries, hunt for bargains, and perform many other online chores.

Q: How does it work?
A: Operator relies on an AI model trained on both text and images to interpret commands and figure out how to use a web browser to execute them.

Q: What are the potential risks and challenges?
A: OpenAI acknowledges that giving ChatGPT access to a web browser introduces new risks. It says that Operator may sometimes misbehave and that it has implemented various new safeguards to prevent this.

Q: Is Operator available to everyone?
A: No, Operator is initially available as a "research preview" for ChatGPT users with a Pro account, which costs a hefty $200 per month. OpenAI plans to expand access while rolling out the tool slowly.

Fast, Low-Cost Inference for Profitable AI

Cost-Effective User Throughput

Businesses are often challenged with balancing the performance and costs of inference workloads. While some customers or use cases may work with an out-of-the-box or hosted model, others may require customization. NVIDIA technologies simplify model deployment while optimizing cost and performance for AI inference workloads. In addition, customers can experience flexibility and customizability with the models they choose to deploy.

  • NVIDIA NIM inference microservices are prepackaged and performance-optimized for rapidly deploying AI foundation models on any infrastructure — cloud, data centers, edge or workstations.
  • NVIDIA Triton Inference Server, one of the company’s most popular open-source projects, allows users to package and serve any model regardless of the AI framework it was trained on.
  • NVIDIA TensorRT is a high-performance deep learning inference library that includes runtime and model optimizations to deliver low-latency and high-throughput inference for production applications.

Available in all major cloud marketplaces, the NVIDIA AI Enterprise software platform includes all these solutions and provides enterprise-grade support, stability, manageability and security.

Cloud-Based LLM Inference

To ease LLM deployment, NVIDIA has collaborated closely with every major cloud service provider to ensure that the NVIDIA inference platform can be seamlessly deployed in the cloud with minimal or no code required.

  • Amazon SageMaker AI, Amazon Bedrock Marketplace, Amazon Elastic Kubernetes Service
  • Google Cloud’s Vertex AI, Google Kubernetes Engine
  • Microsoft Azure AI Foundry coming soon, Azure Kubernetes Service
  • Oracle Cloud Infrastructure’s data science tools, Oracle Cloud Infrastructure Kubernetes Engine

Plus, for customized inference deployments, NVIDIA Triton Inference Server is deeply integrated into all major cloud service providers.

Transforming Agreement Management With Docusign

Docusign, a leader in digital agreement management, turned to NVIDIA to supercharge its Intelligent Agreement Management platform. With over 1.5 million customers globally, Docusign needed to optimize throughput and manage infrastructure expenses while delivering AI-driven insights.

NVIDIA Triton provided a unified inference platform for all frameworks, accelerating time to market and boosting productivity by transforming agreement data into actionable insights. Docusign’s adoption of the NVIDIA inference platform underscores the positive impact of scalable AI infrastructure on customer experiences and ROI. This transformation highlights how robust AI infrastructure can revolutionize financial services.

Serving 400 Million Search Queries Monthly With Perplexity AI

Perplexity AI, an AI-powered search engine, handles over 435 million monthly queries. Each query represents multiple AI inference requests. To meet this demand, the Perplexity AI team turned to NVIDIA H100 GPUs, Triton Inference Server and TensorRT-LLM.

Supporting over 20 AI models, including Llama 3 variations like 8B and 70B, Perplexity processes diverse tasks such as search, summarization and question-answering. By using smaller classifier models to route tasks to GPU pods, managed by NVIDIA Triton, the company delivers cost-efficient, responsive service under strict service level agreements.

Elevating Creative Workflows With Let’s Enhance

To optimize its workflows using the Stable Diffusion XL model in production, Let’s Enhance, a pioneering AI startup, chose the NVIDIA AI inference platform.

Lets Enhance’s latest product, AI Photoshoot, uses the SDXL model to transform plain product photos into beautiful visual assets for e-commerce websites and marketing campaigns.

With NVIDIA Triton’s robust support for various frameworks and backends, coupled with its dynamic batching feature set, Let’s Enhance was able to seamlessly integrate the SDXL model into existing AI pipelines with minimal involvement from engineering teams, freeing up their time for research and development efforts.

Unlocking the Full Potential of AI Inference With Hardware Innovation

Improving the efficiency of AI inference workloads is a multifaceted challenge that demands innovative technologies across hardware and software.

NVIDIA GPUs are at the forefront of AI enablement, offering high efficiency and performance for AI models. They’re also the most energy efficient: NVIDIA accelerated computing on the NVIDIA Blackwell architecture has cut the energy used per token generation by 100,000x in the past decade for inference of trillion-parameter AI models.

The NVIDIA Grace Hopper Superchip, which combines NVIDIA Grace CPU and Hopper GPU architectures using NVIDIA NVLink-C2C, delivers substantial inference performance improvements across industries.

Meta Andromeda is using the superchip for efficient and high-performing personalized ads retrieval. By creating deep neural networks with increased compute complexity and parallelism, on Facebook and Instagram it has achieved an 8% ad quality improvement on select segments and a 6% recall improvement.

With optimized retrieval models and low-latency, high-throughput and memory-IO aware GPU operators, Andromeda offers a 100x improvement in feature extraction speed compared to previous CPU-based components. This integration of AI at the retrieval stage has allowed Meta to lead the industry in ads retrieval, addressing challenges like scalability and latency for a better user experience and higher return on ad spend.

As cutting-edge AI models continue to grow in size, the amount of compute required to generate each token also grows. To run state-of-the-art LLMs in real-time, enterprises need multiple GPUs working in concert. Tools like the NVIDIA Collective Communication Library, or NCCL, enable multi-GPU systems to quickly exchange large amounts of data between GPUs with minimal communication time.

Conclusion

NVIDIA’s advancements in inference software optimization and the NVIDIA Hopper platform are helping industries serve the latest generative AI models, delivering excellent user experiences while optimizing total cost of ownership. The company’s full-stack software optimization approach offers the key to improving AI inference performance and achieving this goal.

Frequently Asked Questions

Q: How does NVIDIA optimize AI inference for cost and performance?

A: NVIDIA optimizes AI inference using its full-stack software optimization approach, which combines world-class silicon, systems, and software for high-throughput and low-latency inference and enables great user experiences while reducing cost.

Q: Which cloud providers collaborate with NVIDIA to ease LLM deployment?

A: NVIDIA has collaborated closely with every major cloud service provider to ensure seamless deployment in the cloud with minimal or no code required, including Amazon, Google Cloud, Microsoft, and Oracle Cloud Infrastructure.

Q: Can NVIDIA Triton Inference Server be used with any AI framework?

A: Yes, NVIDIA Triton Inference Server is a framework-agnostic solution that allows users to package and serve any model, regardless of the AI framework it was trained on.

Upgrading Unresolved:£450 S25 Ultra Cost Keeps Me on Edge

0

Hands-on with the Samsung Galaxy S25 Ultra: Is it Worth Upgrading?

Last night, Samsung announced its latest Galaxy S25 smartphone series at its annual Unpacked event, and I was reporting live from the company’s London HQ to bring you all of the exciting updates. I spent some time after the event getting hands-on with the latest S25 Ultra flagship, and experiencing some very cool demos from Samsung’s experts – but while I had an amazing time at the event, I was still left wondering if the S25 Ultra is a worthwhile upgrade from my Samsung S24 Ultra.

New Audio Erasure AI Feature for Video

If you’re someone who shoots a lot of video content, then the S25 series’ new AI Audio Erasure feature could be a tempting tool. During Unpacked, we were all bombarded with maybe too much information about upcoming AI tools and features for content creators, and as a serious Samsung fan, even I was bored. But it wasn’t until trying out some of these reported features that I realised their true power and potential. Take the Audio Erasure tool for example – Samsung staff had me enter a soundproof booth at the event where a mixture of loud music and audio was being played. They then asked me to record a video with the S25 while speaking over the top, and then showed me how Audio Erasure works to completely isolate my voice in the video clip with no other background sound.

New Camera Upgrades

As a photographer, the number one smartphone feature for me will always be the camera quality. I recently put together a camera phone shootout testing my S24 Ultra against the new Honor Magic 7 Pro, and the quality difference was splitting hairs. Smartphone photography is levelling up fast, and to be honest, I was expecting a little more from Samsung this year in regard to camera upgrades.

With the S25 Ultra, we’re getting a 50MP ultra-wide camera, which is an impressive boost against the previous 12MP quality that I’m used to with my S24 Ultra. But what else is new? There are some fun AI film camera filters available to use, and better object-aware detection tools for enhancing your subject, plus nightography improvements too.

Hands-on Verdict – Should You Upgrade?

It was great to get a brief hands-on experience with the latest S25 series at Samsung last night, but I think to form a proper verdict and truly consider an upgrade to the S25 Ultra, I’d need at least a week of testing it to know how I feel and assess the general performance. In terms of design, these new handsets look stunning, feel very nice and premium to hold, and are more lightweight than their predecessors, so I have no complaints in this area.

As for the pricing, I like that the S25 series is priced exactly the same as Samsung’s S24 series was at launch, and I’ve calculated that with a trade-in discount combined with Samsung’s student discount, plus a coupon code, I’ll only be paying roughly £450 to upgrade to the S25 Ultra. This is a very good price but still has me thinking if the minimal camera upgrades and enhancements I saw during Unpacked are enough to justify the cost.

Conclusion

In my opinion, I think if you’re a Samsung S24 Ultra owner like me, it might be a good idea to sit this year out if you’re cautious of costs. Not everyone can afford to upgrade their flagship every year, but if money is no object then the benefits outweigh this greatly.

FAQs

Q: What are the main upgrades in the S25 Ultra compared to the S24 Ultra?
A: The S25 Ultra features a 50MP ultra-wide camera, AI Audio Erasure feature, and better object-aware detection tools for enhancing your subject, plus nightography improvements.

Q: Is the S25 Ultra worth upgrading from the S24 Ultra?
A: It depends on your individual needs and budget. If you’re a heavy user of video content creation and want the latest features, then the S25 Ultra might be worth upgrading to. However, if you’re on a budget or don’t need the latest and greatest, you might be better off sticking with your S24 Ultra.

Q: What is the price of the S25 Ultra?
A: The S25 Ultra is priced the same as the S24 series was at launch, and with a trade-in discount combined with Samsung’s student discount, plus a coupon code, you can get it for roughly £450.