Home Blog Page 607

Optimizing AI Search

0

Microsoft Provides Guidance on Optimizing Content for AI-Powered Search Engines

Microsoft has provided guidance on how to optimize content for AI-powered search engines, which is timely now that OpenAI has launched ChatGPT Search, which uses Bing’s search index.

AI SEO Recommendations

Intent-Based Content

Content should address the underlying purpose of user queries, Microsoft says:

“Focus on the intent behind the search query rather than just the keywords themselves. For example, if based on your keyword research, you find that users are searching for “how to choose eco-friendly coffee makers,” provide detailed, step-by-step guides rather than just general information.”

Natural Language Processing (NLP)

Websites should leverage NLP techniques to align content with how AI systems process and understand language.

Microsoft states:

“Generative engines, such as Bing Generative Search, deliver content to searchers by understanding and generating human language through Natural Language Processing (NLP). By analyzing vast amounts of text data to learn language patterns, context, and semantics, they’re able to provide relevant and accurate responses to user queries.”

Additionally, Microsoft emphasized the following sentence in italics:

“Leveraging these same NLP strategies in creating your content can optimize it to rank higher, increase its relevance, and enhance its authority, ultimately boosting its visibility and effectiveness.”

Strategic Keyword Implementation

To improve your website and landing pages for AI search engines, Microsoft recommends these keyword strategies:

  • Long-tail keywords for specific user interests
  • Conversational phrases matching natural speech patterns
  • Semantic keywords providing contextual relevance
  • Question-based keywords addressing common user queries

Freshness

Microsoft encourages keeping content updated and suggests using the IndexNow protocol to quickly notify search engines about website changes.

This helps maintain search rankings and ensures AI systems have the latest information.

Microsoft states:

“While it can be tempting to set it and forget it, AI systems depend on the latest, freshest information to determine the most relevant content to display to searchers. Regularly updating your content not only helps maintain your rankings but also keeps your audience engaged with current and valuable information. This practice can significantly influence how AI systems perceive and rank your website.”

Why This Matters

ChatGPT Search now uses Bing’s index, making these optimization strategies vital for websites seeking better visibility in AI-powered searches.

While this can help you create more optimized content, Microsoft acknowledges there’s no “secret sauce” for AI search systems.

Conclusion

In conclusion, Microsoft’s guidance emphasizes the importance of intent-based content, NLP, strategic keyword implementation, and freshness in optimizing content for AI-powered search engines. By following these recommendations, websites can improve their visibility and effectiveness in AI-powered searches.

FAQs

Q: What is the main focus of AI-powered search engines?

A: The main focus of AI-powered search engines is understanding user intent and providing relevant and accurate responses to user queries.

Q: How can I optimize my content for AI-powered search engines?

A: You can optimize your content by focusing on intent-based content, leveraging NLP techniques, implementing strategic keyword strategies, and keeping your content updated and fresh.

Q: Why is freshness important in AI-powered search engines?

A: Freshness is important in AI-powered search engines because AI systems depend on the latest, freshest information to determine the most relevant content to display to searchers. Regularly updating your content helps maintain search rankings and ensures AI systems have the latest information.

The Rabbit R1 Remake

0

Customizing the R1 with Generative UI

Though this seems like a fun way to customize the R1, Rabbit says responses on the AI-generated interfaces are “slower than the default UI on R1 and can take over 30 seconds to appear.” It suggests disabling this feature if you want the fastest responses possible.

Enabling Generative UI

You can turn on generative UI by logging into your rabbithole account, selecting settings, and then clicking “profile.” Once you hit “enable generative UI,” you can enter a prompt, such as: “You are a talented front-end UI designer and your favorite season is autumn. You will generate a very high quality UI in this style and it will look amazing.” Then, hit “customize.”

Limitations of Generative UI

Following the R1’s major update, some reviewers have revisited the device. CNET says the experience has “vastly improved,” but that you’re still much better off with a smartphone. Android Authority was less impressed even after the latest patch.

Conclusion

In conclusion, while generative UI may be a fun feature to play with, it may not be the best option for those looking for fast and efficient responses. The slower response times and limitations of the feature may make it less appealing to some users. However, for those who are interested in exploring the possibilities of AI-generated interfaces, it may be worth giving it a try.

FAQs

Q: What is generative UI?
A: Generative UI is an AI-generated interface feature that allows users to customize their R1 device with unique and personalized designs.

Q: How do I enable generative UI?
A: To enable generative UI, log into your rabbithole account, select settings, and then click “profile.” Hit “enable generative UI” and enter a prompt to customize your interface.

Q: Are there any limitations to generative UI?
A: Yes, responses on the AI-generated interfaces can take over 30 seconds to appear, making it slower than the default UI on R1. Additionally, some reviewers have reported that the feature is not as impressive as expected, even after the latest patch.

Q: Is generative UI worth trying?
A: If you’re interested in exploring the possibilities of AI-generated interfaces and don’t mind slower response times, then yes, generative UI may be worth trying. However, if you prioritize fast and efficient responses, you may want to consider other options.

Furry Friends

0

Support me on Patreon: https://www.patreon.com/sarikas

Introduction

As a creator, I am constantly working on new and exciting projects, and I am grateful for the support of my patrons. Your contributions help me to continue creating content that is engaging, informative, and entertaining. In this article, I will be discussing the importance of supporting creators on Patreon and how it can benefit both the creator and the patron.

The Benefits of Supporting Creators on Patreon

Exclusive Content

One of the main benefits of supporting a creator on Patreon is the exclusive content that they receive. This can include behind-the-scenes footage, early access to new projects, and even personalized messages from the creator. By supporting a creator, you are giving them the opportunity to create more content and share it with you.

Community Engagement

Another benefit of supporting a creator on Patreon is the community engagement that it provides. Patreon allows creators to connect with their fans and build a community around their work. This can include live streams, Q&A sessions, and even in-person events. By supporting a creator, you are becoming part of a community that is passionate about their work.

Financial Support

Finally, supporting a creator on Patreon provides financial support for their work. As a creator, I rely on the support of my patrons to continue creating content and pursuing my passions. By supporting me on Patreon, you are helping me to continue doing what I love.

Conclusion

In conclusion, supporting creators on Patreon is a great way to show your appreciation for their work and to receive exclusive content and community engagement. By supporting a creator, you are giving them the opportunity to continue creating content and pursuing their passions. I am grateful for the support of my patrons and I hope that you will consider supporting me on Patreon.

FAQs

Q: What is Patreon?

A: Patreon is a platform that allows creators to receive financial support from their fans in exchange for exclusive content and community engagement.

Q: How do I support a creator on Patreon?

A: To support a creator on Patreon, simply visit their page and click the “Support” button. You can choose from a variety of tiers and pledge the amount that you are comfortable with.

Q: What kind of content can I expect to receive as a patron?

A: As a patron, you can expect to receive exclusive content, such as behind-the-scenes footage, early access to new projects, and personalized messages from the creator.

Q: How do I communicate with the creator?

A: As a patron, you can communicate with the creator through the Patreon platform. You can leave comments on their posts, ask questions, and even send them messages directly.

Q: Is Patreon only for artists and musicians?

A: No, Patreon is for any type of creator who wants to receive financial support from their fans. This can include writers, podcasters, YouTubers, and more.

Elon Musk Targets Microsoft

0

Elon Musk Updates Lawsuit Against OpenAI, Accuses Microsoft of Antitrust Violations

Elon Musk has updated his fraud, breach of contract, and racketeering lawsuit against OpenAI to make antitrust claims against Microsoft, accusing the two companies of attempting to “monopolize the generative AI market.” The amended complaint filed on Thursday names Microsoft as a new defendant, as well as LinkedIn co-founder Reid Hoffman and Microsoft VP Dee Templeton, a former OpenAI board member.

New Defendants Added to the Complaint

Microsoft has invested $14 billion in OpenAI since 2019 and holds exclusive rights to commercially license the AI startup’s technology and a 49 percent stake in its for-profit subsidiary. Musk’s lawyers say that former OpenAI CEO Sam Altman “engaged in rampant self-dealing” to create a “de facto merger” between the two companies to promote anticompetitive practices.

Antitrust Allegations

The lawsuit argues that OpenAI and Microsoft are “actively trying to eliminate competitors” by exchanging “competitively sensitive information,” and making their investors refrain from funding rival companies like xAI, Musk’s AI company. Both companies are competing for funding in the growing AI market, with OpenAI securing $6.6 billion in October to build more powerful AI models. xAI raised $6 billion in its own funding round in March to accelerate its development of “future technologies.”

New Plaintiff Added to the Complaint

xAI has also been added to the complaint as a new plaintiff, alongside former OpenAI board member Shivon Zilis — an executive at Musk’s Neuralink company and mother of three of his 12 children.

Background on the Lawsuit

Musk co-founded OpenAI in 2015 with Altman and Greg Brockman, who are also defendants in the complaint, before leaving the company in 2018. A previous lawsuit that Musk launched in March (and dropped without explanation in June) accused OpenAI of abandoning its founding agreement to develop AI that will benefit humanity, and claimed its partnership with Microsoft made OpenAI a “closed-source de facto subsidiary” focused on maximizing profits.

Conclusion

The amended complaint aims to stop OpenAI and Microsoft from allegedly engaging in anticompetitive practices that harm the development of AI technology. The lawsuit will likely have significant implications for the future of AI and the tech industry.

FAQs

Q: What is the main accusation in the lawsuit?

A: The lawsuit accuses OpenAI and Microsoft of attempting to monopolize the generative AI market and engaging in anticompetitive practices.

Q: Who are the new defendants in the lawsuit?

A: The new defendants are Microsoft, LinkedIn co-founder Reid Hoffman, and Microsoft VP Dee Templeton, a former OpenAI board member.

Acer Tackles Electronic Waste with Vero Sustainable Range

0

Acer’s Sustainable Vero Product Range: A Game-Changer for the Environment

I got invited to a beautiful Acer launch event last night at London’s Kew Gardens, surrounded by stunning florals and serenaded by a harpist in a greenhouse that perfectly complemented Acer’s new sustainable Vero product range. As someone who loves house plants (and tech), I was completely in my element at this event, in what I can only describe as a very unique branding moment for Acer.

The Star of the Show: Acer’s Flagship Carbon-Neutral Aspire Vero 16 Laptop

The company has teamed up with TV personality, Ben Fogle, to promote its latest eco-friendly Vero campaign, but the real star of the show is Acer’s flagship carbon-neutral Aspire Vero 16 laptop, with a chassis constructed largely from post-consumer recycled plastics (PCR) and renewable materials. Designed with sustainability at its core, Vero products from Acer are not only reliable, affordable, and durable, but have a minimizing impact on the planet too. Sounds like a win-win right?

Acer’s Commitment to Sustainability

It’s clear from speaking with Acer’s team last night that the company is very proud of its recent eco efforts (and rightly so). I think it’s great that Acer is one of the few laptop manufacturers actively making a difference with sustainable operations, rather than simply talking about it or making empty promises. This could be the future of sustainable technology, but it only matters if consumers are also on board.

Acer’s Partnership with Plastic Bank

Acer has said that for every Vero laptop purchased (and registered) in the UK, it will collaborate with Plastic Bank to remove 80kg of plastic waste from the environment. To sweeten the deal, customers will also receive a free set of Vero accessories with their purchase, including a laptop case, mouse, and mouse mat, all made from recycled materials and worth £89.97.

Achieving a More Environmentally Responsible Future

This campaign from Acer also proves that achieving a more environmentally responsible future is possible, and doesn’t have to come at a premium cost to customers either, with Vero laptop prices starting from just £599 (and there are Acer Black Friday deals live right now too!).

Conclusion

It’s evident that there’s no greenwashing going on here, as Acer has been helping to solve environmental challenges behind the scenes for several years now – from launching its Earthion initiative in 2021 and releasing insightful sustainability reports every year since. The Vero range was first launched back in 2021 and has expanded to include monitors, projectors and accessories too.

Frequently Asked Questions

Q: What is Acer’s Vero product range?
A: Acer’s Vero product range is a line of eco-friendly laptops, monitors, projectors, and accessories made from recycled materials and designed with sustainability at its core.

Q: What is the Aspire Vero 16 laptop made of?
A: The Aspire Vero 16 laptop has a chassis constructed largely from post-consumer recycled plastics (PCR) and renewable materials.

Q: How does Acer’s partnership with Plastic Bank work?
A: For every Vero laptop purchased (and registered) in the UK, Acer will collaborate with Plastic Bank to remove 80kg of plastic waste from the environment.

Q: Are Vero laptops expensive?
A: No, Vero laptops are priced competitively, starting from just £599.

Q: Are there any Acer Black Friday deals available?
A: Yes, Acer has live Black Friday deals available, including discounts on its Vero laptop range.

Integrating AI into Workflow

Generative AI Integration in Business

Imagine automating tasks that once required hours of manual labor or generating creative ideas at the click of a button. That’s precisely what many businesses are discovering with generative AI integration services.

Generative AI Integration in Business

Generative AI is a shift in how businesses operate. Today, companies of all sizes are adopting generative AI, from content creation in marketing to predictive analytics in finance. As more companies invest in generative AI API integration, they’re finding that AI tools can lead to impressive gains in productivity and creativity.

Steps to Integrate Generative AI

To integrate generative AI successfully, you need a clear roadmap. Let’s walk through a step-by-step approach to make the transition as seamless and effective as possible.

Step 1: Identifying Opportunities in Your Workflow

To get the most out of generative AI, you need to start by spotting areas where it can make a real difference. Here’s how:

  • Assessing Current Processes: Take a close look at your workflow. Are there repetitive tasks or areas where employees spend too much time? Maybe your marketing team struggles to keep up with content demands, or customer support could use help responding faster. Identifying these tasks can highlight where AI would be most effective.
  • Setting Clear Objectives: Define what you want AI to achieve. Are you aiming to reduce costs, speed up processes, or enhance customer experience? Clear goals will guide your AI strategy.
  • Stakeholder Engagement: Talk with team members who will use AI tools directly. Get their input on needs and expectations to ensure you’re addressing real challenges.
  • Recognize Potential Challenges: Generative AI isn’t without its hurdles. Here are four challenges you might face:
    • Data Privacy: Protecting customer data when using AI can be tricky. You’ll need secure protocols.
    • Skill Gaps: AI requires skills that some team members may not have yet, so training may be needed.
    • High Costs: Implementing and maintaining AI isn’t cheap — plan for these expenses.
    • Integration Issues: New tools can be hard to merge with current systems, requiring technical support.

Step 2: Choosing the Right Generative AI Tools

Once you know where AI can help, it’s time to choose the right tools. What is the best practice when using generative AI? Go for tools that fit your goals, are easy to use, and support scalability.

ROI and Investment Analysis

To demonstrate the value of AI integration, let’s consider an example:

  • Annual Savings: $6,000
  • Investment Cost: $50,000
  • ROI = Annual Savings−Investment Cost/Investment cost ×100 = 44%

In this example, you achieve a 44% ROI in the first year. This calculation not only proves the value of AI integration in business but also shows the cost-effectiveness of automating routine tasks. It’s a clear win when the savings outweigh the initial investment.

Deployment Strategies

When it comes to deploying generative AI, several strategies can optimize performance and ease of access. The most common deployment options are cloud-based and on-premises solutions. Both have advantages, and the right choice depends on factors such as data sensitivity, control requirements, and resource availability.

  • Cloud-based solutions are popular because they’re cost-effective and accessible from anywhere, making them ideal for businesses that require flexibility. They also offer easy scalability, allowing you to adjust resources based on demand.
  • On the other hand, on-premises solutions offer greater control over data and security, which is crucial for industries with strict compliance standards. Although on-premises setups may require a larger initial investment, they offer long-term savings for businesses with stable or sensitive data requirements.

Wrapping Up

Incorporating generative AI into your workflow can transform how your business operates, from improving efficiency to unlocking new creative potential. We’ve walked through each critical step of AI integration – from identifying opportunities to measuring ROI – and discussed deployment strategies to consider for the best results.

Frequently Asked Questions

Q: What are the benefits of generative AI integration?
A: Generative AI integration can lead to impressive gains in productivity and creativity, streamlining tasks, and unlocking new business opportunities.

Q: What are the challenges of generative AI integration?
A: Generative AI integration requires careful planning, ongoing support, and regular analysis. Potential challenges include data privacy, skill gaps, high costs, and integration issues.

Q: What is the ROI of generative AI integration?
A: The ROI of generative AI integration can vary depending on the specific implementation and industry. However, with careful planning and analysis, AI integration can lead to significant cost savings and increased efficiency.

Q: What are the deployment strategies for generative AI?
A: The most common deployment strategies for generative AI are cloud-based and on-premises solutions. Each has its advantages, and the right choice depends on factors such as data sensitivity, control requirements, and resource availability.

SUSE Unveils AI-Driven Data Protection Platform

0

SUSE Redoes Branding, Geeko Sticking Around

Sailing Forward on an Even Keel

At KubeCon North America, SUSE announced a significant rebranding effort, several new product offerings, and the launch of SUSE AI, a secure platform for deploying and running generative AI (gen AI) applications.

Renaming the Portfolio

SUSE has renamed its entire portfolio to make product names more descriptive and customer-friendly. Notable changes include:

  • Liberty Linux, the company’s Red Hat Enterprise Linux (RHEL)/CentOS clone and support offering, becomes SUSE Multi Linux Support.
  • Harvester is rebranded as SUSE Virtualization

Why the Changes?

The company wants to make its product names more descriptive and customer-friendly. The previous names didn’t have a clear connection to the parent company, and the new names aim to address this issue.

New Programs and Offerings

SUSE has launched several new programs and offerings, including:

  • SUSE Observability: A full-stack observability solution available as a Software-as-a-Service (SaaS) offering, marking SUSE’s first entry into the SaaS market.
  • SUSE Rancher Prime: An enhanced commercial version of its container management platform, incorporating security features from New Vector (now called SUSE Security) and its newly acquired full-stack observability capabilities.
  • SUSE AI: A secure platform for deploying and running gen AI applications, addressing key challenges faced by enterprises as they move from AI experimentation to deployment, particularly in areas of security and compliance.

SUSE AI Features

The top features of SUSE AI are:

  1. Security by Design: SUSE AI provides security and certifications at the software infrastructure level, along with zero-trust security tools, templates, and compliance playbooks.
  2. Multifaceted Trust: The platform ensures that generated data is correct and private customer and IP data remain secure. It supports deployment across various environments, including on-premise, hybrid, cloud, and air-gapped setups.
  3. Choice and Flexibility: SUSE AI allows customers to select and deploy their preferred AI components and LLMs.
  4. Simplified Operations: The platform provides simplified cluster operations, persistent storage, and easy access to pre-configured shared tools and services.

Conclusion

As SUSE continues to evolve its product lineup and branding, it’s reinforcing its identity not only as an important enterprise Linux contender but also as a top, cloud-native, and secure AI vendor. Keep an eye on Geeko, the SUSE chameleon. It’s going places.

FAQs

Q: Why is SUSE rebranding its portfolio?
A: SUSE is rebranding its portfolio to make product names more descriptive and customer-friendly.

Q: What is SUSE AI?
A: SUSE AI is a secure platform for deploying and running generative AI (gen AI) applications.

Q: What are the top features of SUSE AI?
A: The top features of SUSE AI are Security by Design, Multifaceted Trust, Choice and Flexibility, and Simplified Operations.

Q: Is SUSE entering the SaaS market with SUSE Observability?
A: Yes, SUSE Observability is a full-stack observability solution available as a Software-as-a-Service (SaaS) offering, marking SUSE’s first entry into the SaaS market.

Microsoft Confuses with Bizarre Xbox Ads

0

Microsoft’s Confusing Xbox Campaign: What Does it Mean?

You know what an XBox is, right? Even if you don’t have one because you prefer PS5 or PS5 Pro. Or even if you’re not interested in gaming at all, you’e probably never felt the need to ask deep ontological questions about the nature of Microsoft’s gaming console.

A New Campaign

But Microsoft begs to differ. It thinks people still need to know what an Xbox is. And it thinks the way to clarify that is to point out what an Xbox isn’t… At least we think that’s the idea.

The Ads

Microsoft’s ‘This is an Xbox’ campaign comprises a series of ads for online, digital billboards and buses. The aim is to show that Xbox players can use TVs, laptops, handheld gaming PCs and VR headsets to play.

What’s the Point?

According to Craig McNary, senior director of Xbox marketing: “This Is an Xbox invites people to play with Xbox across multiple devices and screens. It showcases the evolution of Xbox as a platform that extends across devices, with bold, iconic, fun visuals and a light-hearted tone.”

Confusion Reigns

In a way, perhaps Microsoft’s campaign works since it has people asking a question they thought they knew the answer to, namely, “what on Earth an Xbox?” The problem is that it’s so confusing, it doesn’t exactly make me inclined to discover the answer. The public and even other brands are wondering what other products might also now be an Xbox, turning the campaign into a meme already.

Conclusion

While the campaign may be generating engagement, it’s unclear whether it’s achieving its intended goal of clarifying what an Xbox is. Perhaps a more straightforward approach would be more effective. Nonetheless, it’s an interesting experiment in marketing, and it will be interesting to see how it plays out.

FAQs

Q: What is the purpose of Microsoft’s “This is an Xbox” campaign?
A: The campaign aims to show that Xbox players can use multiple devices and screens to play.

Q: What devices can Xbox players use?
A: According to the campaign, Xbox players can use TVs, laptops, handheld gaming PCs, and VR headsets.

Q: Is the campaign successful?
A: While it’s generating engagement, it’s unclear whether it’s achieving its intended goal of clarifying what an Xbox is.

Q: What is the tone of the campaign?
A: The campaign has a light-hearted tone, with bold and iconic visuals.

New method uses crowdsourced feedback to help train robots | MIT News

0

To teach an AI agent a new task, like how to open a kitchen cabinet, researchers often use reinforcement learning — a trial-and-error process where the agent is rewarded for taking actions that get it closer to the goal.

In many instances, a human expert must carefully design a reward function, which is an incentive mechanism that gives the agent motivation to explore. The human expert must iteratively update that reward function as the agent explores and tries different actions. This can be time-consuming, inefficient, and difficult to scale up, especially when the task is complex and involves many steps.

Researchers from MIT, Harvard University, and the University of Washington have developed a new reinforcement learning approach that doesn’t rely on an expertly designed reward function. Instead, it leverages crowdsourced feedback, gathered from many nonexpert users, to guide the agent as it learns to reach its goal.

While some other methods also attempt to utilize nonexpert feedback, this new approach enables the AI agent to learn more quickly, despite the fact that data crowdsourced from users are often full of errors. These noisy data might cause other methods to fail.

In addition, this new approach allows feedback to be gathered asynchronously, so nonexpert users around the world can contribute to teaching the agent.

“One of the most time-consuming and challenging parts in designing a robotic agent today is engineering the reward function. Today reward functions are designed by expert researchers — a paradigm that is not scalable if we want to teach our robots many different tasks. Our work proposes a way to scale robot learning by crowdsourcing the design of reward function and by making it possible for nonexperts to provide useful feedback,” says Pulkit Agrawal, an assistant professor in the MIT Department of Electrical Engineering and Computer Science (EECS) who leads the Improbable AI Lab in the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL).

In the future, this method could help a robot learn to perform specific tasks in a user’s home quickly, without the owner needing to show the robot physical examples of each task. The robot could explore on its own, with crowdsourced nonexpert feedback guiding its exploration.

“In our method, the reward function guides the agent to what it should explore, instead of telling it exactly what it should do to complete the task. So, even if the human supervision is somewhat inaccurate and noisy, the agent is still able to explore, which helps it learn much better,” explains lead author Marcel Torne ’23, a research assistant in the Improbable AI Lab.

Torne is joined on the paper by his MIT advisor, Agrawal; senior author Abhishek Gupta, assistant professor at the University of Washington; as well as others at the University of Washington and MIT. The research will be presented at the Conference on Neural Information Processing Systems next month.

Noisy feedback

One way to gather user feedback for reinforcement learning is to show a user two photos of states achieved by the agent, and then ask that user which state is closer to a goal. For instance, perhaps a robot’s goal is to open a kitchen cabinet. One image might show that the robot opened the cabinet, while the second might show that it opened the microwave. A user would pick the photo of the “better” state.

Some previous approaches try to use this crowdsourced, binary feedback to optimize a reward function that the agent would use to learn the task. However, because nonexperts are likely to make mistakes, the reward function can become very noisy, so the agent might get stuck and never reach its goal.

“Basically, the agent would take the reward function too seriously. It would try to match the reward function perfectly. So, instead of directly optimizing over the reward function, we just use it to tell the robot which areas it should be exploring,” Torne says.

He and his collaborators decoupled the process into two separate parts, each directed by its own algorithm. They call their new reinforcement learning method HuGE (Human Guided Exploration).

On one side, a goal selector algorithm is continuously updated with crowdsourced human feedback. The feedback is not used as a reward function, but rather to guide the agent’s exploration. In a sense, the nonexpert users drop breadcrumbs that incrementally lead the agent toward its goal.

On the other side, the agent explores on its own, in a self-supervised manner guided by the goal selector. It collects images or videos of actions that it tries, which are then sent to humans and used to update the goal selector.

This narrows down the area for the agent to explore, leading it to more promising areas that are closer to its goal. But if there is no feedback, or if feedback takes a while to arrive, the agent will keep learning on its own, albeit in a slower manner. This enables feedback to be gathered infrequently and asynchronously.

“The exploration loop can keep going autonomously, because it is just going to explore and learn new things. And then when you get some better signal, it is going to explore in more concrete ways. You can just keep them turning at their own pace,” adds Torne.

And because the feedback is just gently guiding the agent’s behavior, it will eventually learn to complete the task even if users provide incorrect answers.

Faster learning

The researchers tested this method on a number of simulated and real-world tasks. In simulation, they used HuGE to effectively learn tasks with long sequences of actions, such as stacking blocks in a particular order or navigating a large maze.

In real-world tests, they utilized HuGE to train robotic arms to draw the letter “U” and pick and place objects. For these tests, they crowdsourced data from 109 nonexpert users in 13 different countries spanning three continents.

In real-world and simulated experiments, HuGE helped agents learn to achieve the goal faster than other methods.

The researchers also found that data crowdsourced from nonexperts yielded better performance than synthetic data, which were produced and labeled by the researchers. For nonexpert users, labeling 30 images or videos took fewer than two minutes.

“This makes it very promising in terms of being able to scale up this method,” Torne adds.

In a related paper, which the researchers presented at the recent Conference on Robot Learning, they enhanced HuGE so an AI agent can learn to perform the task, and then autonomously reset the environment to continue learning. For instance, if the agent learns to open a cabinet, the method also guides the agent to close the cabinet.

“Now we can have it learn completely autonomously without needing human resets,” he says.

The researchers also emphasize that, in this and other learning approaches, it is critical to ensure that AI agents are aligned with human values.

In the future, they want to continue refining HuGE so the agent can learn from other forms of communication, such as natural language and physical interactions with the robot. They are also interested in applying this method to teach multiple agents at once.

This research is funded, in part, by the MIT-IBM Watson AI Lab.

Draft Regulatory Guidance for AI Models

0

EU Releases Draft General-Purpose AI Code of Practice for Regulatory Guidance

The development of the "First Draft General-Purpose AI Code of Practice" marks a significant effort by the EU to create comprehensive regulatory guidance for general-purpose AI models. This draft has been a collaborative effort, involving input from diverse sectors, including industry, academia, and civil society.

Key Objectives

The draft aims to clarify compliance methods for providers of general-purpose AI models, facilitate understanding across the AI value chain, ensure compliance with Union law on copyrights, and continuously assess and mitigate systemic risks associated with AI models.

Recognizing and Mitigating Systemic Risks

The draft emphasizes the need for robust safety and security frameworks (SSFs) and proposes a hierarchy of measures, sub-measures, and key performance indicators (KPIs) to ensure appropriate risk identification, analysis, and mitigation throughout a model’s lifecycle.

Taxonomy of Systemic Risks

The draft outlines various threats, including cyber offenses, biological risks, loss of control over autonomous AI models, and large-scale disinformation. The document acknowledges that this taxonomy will need updates to remain relevant as AI technology continues to evolve.

Proactive Stance on AI Regulatory Guidance

The EU AI Act mandates that the final version of this Code be ready by 1 May 2025. This initiative underscores the EU’s proactive stance towards AI regulation, emphasizing the need for AI safety, transparency, and accountability.

Conclusion

While still in draft form, the EU’s Code of Practice for general-purpose AI models could set a benchmark for responsible AI development and deployment globally. By addressing key issues such as transparency, risk management, and copyright compliance, the Code aims to create a regulatory environment that fosters innovation, upholds fundamental rights, and ensures a high level of consumer protection.

Frequently Asked Questions

Q: What is the purpose of the First Draft General-Purpose AI Code of Practice?
A: The purpose of the draft is to create comprehensive regulatory guidance for general-purpose AI models, ensuring their safe and responsible development and deployment.

Q: What are the key objectives outlined in the draft?
A: The draft aims to clarify compliance methods for providers of general-purpose AI models, facilitate understanding across the AI value chain, ensure compliance with Union law on copyrights, and continuously assess and mitigate systemic risks associated with AI models.

Q: What is the EU AI Act, and how does it relate to the Code of Practice?
A: The EU AI Act mandates that the final version of this Code be ready by 1 May 2025, emphasizing the EU’s proactive stance towards AI regulation, emphasizing the need for AI safety, transparency, and accountability.