To this end, says Lange, IC-Foods is a partner in Icicle.AI, a National Science Foundation-funded institute operating out of Ohio State University. It’s the first seeking to “build cyber-infrastructure for AI that is itself built on top of AI. In other words, it’s AI for cyber-infrastructure for AI – AI for CI for AI. so that it gets smarter.” This involves machine learning (ML), which is itself a subset of AI, “but there will also be other methods of intelligent computing and data gathering that don’t necessarily involve ML,” he says.
“Digital agriculture” is one of three “use cases” that Icicle.AI is pursuing — encompassing, for example, self-driving tractors and smart irrigation systems informed by the weather, all enabled through connectivity, he notes.
“We’re about democratizing AI,” he asserts. “What would it look like if you could access AI for things you wanted to figure out, at the flick of a switch, in the same way you can get running water or electricity? The everyday consumer is a bit of a reach in this early stage, but food systems — and being able to rapidly pivot in the case of a disaster — makes a lot of sense and is good for the population as a whole.”
Icicle.AI, launched in October with $20 million in funding, to keep it going for five years. Besides IC-Foods, its partners include nine universities and four supercomputer facilities, Lange says.
Sensors are a window into nature that can help predict the future, and with edge computing and AI built into farming equipment, it’s possible to create a more resilient food system and devise better farming practices, he explains.
“Thinking about the challenges of agriculture — from high levels of variability, narrow windows of time, availability of labor whether skilled or unskilled — over the course of the next decade, we will have an autonomous production system” and “not just autonomy of tractors,” says Dan Leibfried, director of automation and autonomy at Deere & Co.’s John Deere Intelligent Solutions Group, based in Urbandale, IA.
Previously farmland was managed as one big block of land, Leibfried recalls. “The realities of agriculture, though, is it’s highly variable” across a field, with diverse soils and rolling topography. In the 1990s, precision agriculture technology began to manage zones of a field, then to manage at the row level of a crop. “Going forward into the future it’s going to get to a point where it’s managing at the plant level,” he declares.
Deere’s own technological progression mirrors this. In the 1990s the company began utilizing GPS to precisely document soil variability, then in the 2000s integrated it as an input to a control system for precision guidance and auto-steering that can stay within an inch of a target line on a repeatable basis. From 2011, cellular-based cloud connectivity was added to Deere’s large agricultural equipment, to “turn data into insights, using connectivity as well as the scalability of cloud-based computing,” Leibfried says. “That was the second big change.”
Now, computer vision and machine learning are being used “to even more precisely manage an agricultural field at the plant level,” such as with camera-based technology put on a sprayer to differentiate between a weed, a crop and soil, so that herbicide is applied only to the weed — reducing herbicide usage by 60% to 90% across a field, and thereby improving environmental stewardship and lowering production costs. “Computer vision and machine learning, is one of the next big technology breakthroughs for agriculture to help farmers manage at the plant level and do it at scale.”
The company debuted a tremendous, multi-ton robotic harvester (known as a combine) at CES 2019, which integrated cameras with AI to sense the quality of the crop coming through it and make automatic adjustments to the machine based on what’s detected, in near real-time. However, harvesting “is the last step” in farming that “gives the farmer a scorecard for the year” regarding crop quality and potential. In 2020, the company featured a large self-propelled sprayer outfitted with the camera-based weed sensing technology. And for CES 2021, the company used virtual reality (VR) to show a tractor with electric-drive robot seed planters spanning the width of the machine, capable of precisely laying down more than 30,000 seeds at the bottom of a trench of soil while traveling over 10 miles per hour.
At CES 2022, Deere will demonstrate at an outdoors exhibit “the next step in our journey,” with a tractor that has utility across multiple farming applications, Leibfried says. “We will have a broad focus around further levels of automation, but a strong emphasis on where we’re going in autonomy this year.”
Autonomy and automation are tied together, says Parag Garg, chief digital officer at CNH Industrial NV, the second-largest maker of agricultural equipment in the world, after Deere. Its brands include Case International Harvester and New Holland. The state-of-the-art today is “Level 4.5” — understood in agriculture to be a bit beyond supervised autonomy — the industry “will continue to be on the journey to full autonomy,” Garg says. The future of farming will comprise four megatrends: defining and enabling an ecosystem that ties different kinds of machines together with “open APIs” (application programming interfaces) that make farming digital and seamless; a digital customer experience that lets farmers buy, maintain and trade-in their machines online; automation and autonomy; and a new model for service and support required by this new digital world.
To be sure, startups are innovating in agricultural machinery, too. Take, for instance, Advanced Farm Technologies Inc., based in Davis, CA. The three-year-old company is devising a self-driving hybrid EV with an on-board gasoline-powered generator (akin to the discontinued Chevy Volt car) specifically for harvesting strawberries. It uses a stereo camera and AI to determine which strawberries are ripe and picks only those, explains Kyle Cobb, co-founder. Advanced Farm has partnered with Yamaha and Kubota, both of which are investors in the company. The partnerships are expected to help the company move toward mass production of the machine, Cobb says. Working prototypes have harvested millions of berries since early 2020, with about a dozen prototypes in fields right now, he says.
Auto industry suppliers are involved in smart agriculture, as well. In 2016, for example, Robert Bosch LLC — a Tier 1 supplier to automakers — launched a Commercial Vehicles and Off-Road (CVO) unit devoted to agriculture, construction and material handling. “We wanted to try to bring the scale of the automotive components that Bosch has as a technology provider, and bring that into the off-highway space,” says Jason Keith, CVO’s director of sales, based in Farmington Hills, MI. “Historically that was a very challenging thing, we found,” because the driving environment is very different off-road, where there are no lane markers or framed borders. This necessitated adapting automotive multi-camera systems, radar and ultrasonic sensors for these differences, he explains.
But Bosch is not offering complete automated steering systems to manufacturers like Deere or CNH that have already developed those themselves, Keith says. Rather, Bosch is concentrating on providing those sensors and connectivity technologies to facilitate other intelligent features for off-road users.
One example is NEVONEX, a connected ecosystem that enables suppliers, like seed or fertilizer companies, to provide digital services to ensure their products are applied at the proper time for the best possible outcome. To wit, the farmer can scan a barcode on a package of seeds, and the machine via a cloud interface can then be set up automatically through the NEVONEX system to spread it, and once done, upload the planting details to a farm management system. NEVONEX will begin rolling out commercially next year, Keith says. It’s in a test phase now with 30 partners including equipment makers, suppliers, dealers and connectivity device providers.
CVO will be exhibiting NEVONEX at CES in the larger Bosch booth.
While the business unit’s major focus is agriculture, it is also focused to a lesser degree on construction, and mining — utilizing the same multi-camera, radar and ultrasonic sensors, Keith notes.
The Toy that Became the Machine
Children love to play with toy replicas of construction equipment, such as wheel loaders and dump trucks. Now, engineers at Volvo Group have brought such a toy to full-size life, in partnership with another famous Swedish company: LEGO Group.
Unveiled in October, the Concept LX03 is a fully autonomous, battery-electric, self-learning wheel loader prototype by Volvo Construction Equipment (Volvo CE), based on a LEGO Technic model.
Endowed with “the brains to make decisions, perform tasks and interact with humans,“ it heralds advances in smart construction technology as well as toy transformation. It represents both the company’s further foray into machine intelligence and its determination to decarbonize the construction industry, and marks the first time a LEGO Technic model has been turned into a real machine.
“Together with the LEGO Group we are pushing the boundaries of both technology and imagination and the result is beyond anything the world has seen before,” says Melker Jernberg, president of Volvo CE.
Niels Henrik Horsted, LEGO Group’s head of product for LEGO Technic says, “Our two companies have enjoyed an extremely successful partnership over the years in which we have collaborated on several LEGO Technic models. But this is the first time we are making a real machine based on a model and not the other way around — and that is what makes this a truly unique project.”
Volvo CE and LEGO began exploring the future of construction together with a collaboration between engineers and designers, then expanded their project to involve a team of children. That resulted in the toy that gave rise to the machine, formally called the 42081 LEGO Technic Concept Wheel Loader ZEUX.
The Volvo CE LX03 is a five-ton wheel loader developed as a modular concept, able to be made larger or smaller with a few changes to the manufacturing process. Its computer intelligence allows it to adapt to different scenarios, make decisions in real-time and collaborate with humans. It also can complete heavy, repetitive or dangerous tasks, thus making a job site safer. It shares its driveline with Volvo CE’s L25 Electric wheel loader, so it’s also a zero-emission, low-noise machine that can operate for up to eight hours, Volvo CE says.
Electrification and Autonomy in Mining
“There is a broad shoreline of opportunities to leverage the technology from automotive into agriculture and construction, and likely vice versa,” says John Deere’s Leibfried. Construction is another industry vertical that John Deere serves, “and I believe that in certain applications it’s going to require multiple sensors, like radar, LiDAR and cameras. Some you’re going to be able to do effectively with cameras, and some with just LiDAR. Having capabilities across multiple technologies allows us to accelerate our journey to solve for the variety of use cases that are out there.”
Deere is a leader in both construction for earth moving and road building technologies, Leibfried says. “We’re now starting to apply the broader technology stack that [the company] has to our construction space,” to accelerate the “transition to automation and autonomy. We’ve been doing it partially over the course of the last decade,” he adds.
Autonomy is most advanced in the mining industry, asserts Karl Weiss, CTO at Caterpillar Inc., based in Deerfield, IL. In fact, Weiss says, Caterpillar has been working to automate and make autonomous mining machines for over 30 years, and has the largest installed base of self-driving mining haul trucks worldwide at nearly 500. And collectively, they’ve moved themselves over 135 million kilometers, which is 2.5 times farther than any automaker’s self-driving fleet has traveled, Weiss says.
It was Caterpillar that developed the first LiDAR used in experimental self-driving cars — albeit done in partnership with a Tier 1 automotive industry supplier. Like automakers, Caterpillar is now pushing toward EVs. “In the next five years we’ll be bringing together the electrified mining fleet and autonomy,” and “autonomy will have a significant role in how that plays out,” Weiss says.
In November, Caterpillar announced a strategic alliance with Newmont Corp., the world’s largest gold mining company, to deploy 26 first-of-a-kind battery electric, fully-connected and autonomous haul trucks by 2027 — for use in both underground and open pit operation at mines across two continents.
“It’s an exciting time because so many things are possible now technology-wise,” Weiss declares.
I3, the flagship magazine from the Consumer Technology Association (CTA)®, focuses on innovation in technology, policy and business as well as the entrepreneurs, industry leaders and startups that grow the consumer technology industry. Subscriptions to i3 are available free to qualified participants in the consumer electronics industry.