Businesses are still betting on generative AI despite media skepticism

Bob O'Donnell

Posts: 138   +2
Staff member

At this point, it seems many people are starting to give up on the impact Generative AI was supposed to have. After all, haven't we already fallen into the dreaded "trough of disillusionment"? The tenor of media coverage, social media posts, and more has clearly shifted from giddy excitement to weary skepticism, driven by a fear of overhyping the technology.

But out in the real world, it's clear that GenAI initiatives across businesses of all sizes and industries are actually just starting to shift into higher gear.

A new study by TECHnalysis Research emphasizes this point. "The Intelligent Path Forward: GenAI in the Enterprise" is based on a web survey of over 1,000 US-based IT decision makers across ten industries and both medium businesses (100-999 employees) and large enterprises (1,000+ employees).

The study results show that not only are investments in GenAI initiatives continuing, but companies are also finding new sources of funding to support these efforts. Over half of the survey respondents said they're using funds outside traditional IT to help pay for these efforts – 31% from special budgets dedicated to GenAI, and another 22% from other corporate budgets or initiatives, such as business units.

Fig. 1

The results shown in Figure 1 above. It's an amazing statistic that highlights how companies continue to be enthusiastic about their GenAI-related efforts (as well as how disconnected many short-term thinking pundits are from what's really happening!).

In addition to their continued enthusiasm, companies are evolving their thinking about how and where GenAI deployments are taking place. Due to the need to use vast amounts of critical, often sensitive, data to train and fine-tune the models driving their GenAI applications, many organizations are interested in conducting more of this work within their own data centers or colocation facilities.

While cloud-based GenAI efforts continue to dominate and will likely remain the majority for some time, a remarkable 80% of respondents expressed some degree of interest in local deployments. This shift from established industry practices represents a significant opportunity for GenAI industry participants to develop new products, services, and solutions to meet these needs.

As Figure 2 highlights below, there are still several challenges that need to be addressed before these local efforts become a reality – not the least of which is a dramatic need for more education and training – but the potential pivot opens up some very interesting new paths for industry evolution.

Fig. 2

In addition to new funding sources and deployment strategies, the study uncovered overlooked challenges that aren't being widely addressed. Many early GenAI efforts failed due to issues with data quality and the processes used for model training and tuning – topics directly related to provenance (determining the source and characteristics of the model and data) and governance (procedures to ensure output quality and mitigate potential risks).

Among medium-sized businesses, a staggering 84% reported having no provenance policies, and 64% lacked governance policies. Large enterprises fared better, but even there, about a quarter had no provenance policies, and a fifth had no governance procedures. (See "Two Words That Are Critical to GenAI's Future" for more on provenance and governance.)

The number one benefit that organizations hope to get from their GenAI initiatives is increased efficiency and productivity followed by improved quality and accuracy of output.

While some of the study's findings were surprising, others confirmed what many in the industry have been thinking. The number one benefit that organizations hope to get from their GenAI initiatives, for example, is increased efficiency and productivity followed by improved quality and accuracy of output.

When asked to the rank the importance of the potential outcomes of their GenAI efforts, however, the results showed more pragmatic, measurable results. Most importantly, companies said they wanted to create new products or services with the help of GenAI, and reducing costs was their second most important outcome. Not only does this reflect the fact that benefits and importance don't always align when it comes to these initiatives, but it also indicates that organizations recognize what GenAI can offer now, yet still have more aspirational goals for the future.

In terms of the GenAI-powered applications that organizations are using, as Figure 3 illustrates, the first and third top choices are text-related with Text-Based Document Creation number one and Text-based Summarization number three.

Fig. 3

Collaboration-based applications came in second, reflecting the popularity of GenAI features such as meeting summarizations, automatic note-taking, language translation, and other capabilities integrated into messaging platforms. Despite their heavy usage, satisfaction with collaboration tools was found to be lower than with other product categories.

The study also dives into more detailed aspects of the companies' GenAI efforts, including which foundation models and platforms they're using, why they chose them, techniques for data preparation and model fine-tuning, the deployment of GenAI applications at the edge, on PCs, and on smartphones, as well as the types of partners companies are working with and the specific services they need.

Finally, returning to the original theme, GenAI-powered summarization and sentiment analysis of the survey respondents' comments highlight that we're still in the early stages of the GenAI revolution. While companies expressed legitimate concerns about GenAI and its impact, they also made it clear that they understand the long-term potential of the technology and are eager to integrate it into their organizations.

---

If you'd like to download a free copy of the summary results from "The Intelligent Path Forward: GenAI in the Enterprise", you can find it here. The full study with detailed breakdowns for all topics by company size and industry is also available for purchase.

Bob O'Donnell is the president and chief analyst of TECHnalysis Research, LLC, a market research firm that provides strategic consulting and market research services to the technology industry and professional financial community. You can follow Bob on Twitter

Masthead image: Gerard Siderius

Permalink to story:

 
"despite media skepticism"...

The people making the tech are not even sure of where it will lead. Who cares about the opinions of people who use AI to put out click bait news.
 
Tough spot to be in, but I know the feeling. I too can be stupid with my money when excited about something new.

Game theory says no one or business will ever be perfect with spending money. main thing is we improve.
I'm got stuff lying around unused, too many interests. so next thing eg 3D printer , Point is most should be discretionary income, not some scam junk and not too egregious.
Also my hobbies are not in big league , boats, planes and automobiles.
Someone cash strapped thinks they will play golf, thinks they will get good and spends 5-10K on clubs etc when a friend offered to borrow then a set for starting out.

I'm not hard on myself, can move on. plus I know that I can cut out most silly spending if I have too - eh a Steam games on deep discount I won't play . Plus I know my expenses in other areas are not huge, not owning and running a huge home, or an expensive car to impress people , because I don't care what people think and it's only a car, ie quite boring to me.

A hungry wolf is meant to be a better hunter. more focused and determined , should be true to some extend with money. Plus in developed world we have lots of fall backs. nearly no one starves to death
 
I think once all the hype settles down, research and evolution can maybe become more daring as there are less eyes watching and less criticism and all the good stuff comes out, perhaps being less transparent? Just a thought though.
 
Deploying it may not be tough, but the real test is whether it will be very beneficial for companies implementing AI solutions in the long term. Some companies have the budget and want to explore further. They will figure out if AI is a silver bullet for them eventually.
 
Putting my personal snarky feelings about AI aside, I have been following business news reports in general on the overall development of AI and the sheer amount of financial investment and material and energy resources put into it without any clear ROI path is alarming. It's already at the point where even if we get a genuinely useful mainstream AI product that becomes as essential to our lives as, say, our smartphones or Google, there is basically 0% chance it can actually make a profit for anyone. We could seriously be looking at an equivalent of the dot.com boom and bust of the early 2000's. Most likely far worse than that.
 
Putting my personal snarky feelings about AI aside, I have been following business news reports in general on the overall development of AI and the sheer amount of financial investment and material and energy resources put into it without any clear ROI path is alarming. It's already at the point where even if we get a genuinely useful mainstream AI product that becomes as essential to our lives as, say, our smartphones or Google, there is basically 0% chance it can actually make a profit for anyone. We could seriously be looking at an equivalent of the dot.com boom and bust of the early 2000's. Most likely far worse than that.
Awhile back, I saw an article stating that the money spent on AI amounts to about $20,000 per person. I can't find the source and I don't remember if that is in the world or in the US, but that is still a lot of money. Considering that that number is accurate and how long ago it was, it's definitely larger now.

With no ROI path, I'm really curious how they plan to recoupe that money.

I've also seen another trend that is, at the very least, interesting. I'm active in the Linux community and none of the devs or users seem to have any interest in implementing AI into Linux.

The reason I find that relevant is that the Linux community is made up of some of the smartest in tech. If there is no interest or plan to use AI from that community then I really wonder how these companies see AI as the next big thing in tech.
 
Awhile back, I saw an article stating that the money spent on AI amounts to about $20,000 per person. I can't find the source and I don't remember if that is in the world or in the US, but that is still a lot of money. Considering that that number is accurate and how long ago it was, it's definitely larger now.

With no ROI path, I'm really curious how they plan to recoupe that money.

I've also seen another trend that is, at the very least, interesting. I'm active in the Linux community and none of the devs or users seem to have any interest in implementing AI into Linux.

The reason I find that relevant is that the Linux community is made up of some of the smartest in tech. If there is no interest or plan to use AI from that community then I really wonder how these companies see AI as the next big thing in tech.
Very interesting insight, Raz. The reason I started following the financial and business trends on AI is that I have a smart lawyer friend who works at a very large and well respected financial consulting firm and he told me they have twice turned down AI startup initiatives here in Canada. The rationale the company had was that there was no clear ROI and the exact term the very capable upper management used in the decision meeting he was a part of was "This is an incredible solution in search of a non-existent problem it can solve."
 
Very interesting insight, Raz. The reason I started following the financial and business trends on AI is that I have a smart lawyer friend who works at a very large and well respected financial consulting firm and he told me they have twice turned down AI startup initiatives here in Canada. The rationale the company had was that there was no clear ROI and the exact term the very capable upper management used in the decision meeting he was a part of was "This is an incredible solution in search of a non-existent problem it can solve."
Interesting comment; though there are more than a few things that when invented/discovered, There was no idea what good they might be. Perhaps some of them were found useful, while others were not.;)
 
Back