robotics and autonomous systems

Xuesu Xiao

Topics

competitions

Electrical Engineering

Computer Engineering

computer science

College of Engineering and Computing

robotics

Drones and rovers save the day at Raytheon Autonomous Vehicle Competition 2025

Jennifer Pocock — Thu, 01 May 2025 18:18:35 +0000

Drones and rovers save the day at Raytheon Autonomous Vehicle Competition 2025 Jennifer Pocock Thu, 05/01/2025 - 14:18

As the saying goes, if you love something, set it free. If it maps an area, finds a target, delivers a package, and comes back, the trophy is yours forever. Or something like that.

The Raytheon Autonomous Vehicle Competition Team poses with their ground and air robots. Photo by Jenn Pocock

The black quadcopter drone surveyed the field in two quick swoops against a cloud-heavy sky. In just a matter of seconds, it picked up a signal and flew to the sidelines where it landed itself. A small ground rover took off, bumping over the grass to drop a first aid kit a few feet from the goal. Team members on the side of the field exploded with cheers and high fives.

The entire search and rescue took less than two minutes.

Senior electrical engineering student Qeon Edwards jumped with joy at just how well and how quickly their vehicles performed. “What, you doubted us?” he laughed, obviously relieved.

It was late in April when five teams gathered at the Xelevate drone ecosystem field in Leesburg, Virginia, to test their autonomous programming mettle via ground and air vehicles. This was 91��’s second year in the competition, which they won last year. The team consisted of 16 students ranging from sophomores to PhDs in computer science, electrical engineering, and mechanical engineering. As the reigning champs, they had a lot to prove.

A quadcopter takes off from the starting line to search for its target, as the rover and judges stand by. Photo by Jenn Pocock

The challenge rules change every year, so the team can’t just copy their predecessors’ codes. “Last year was basically a game of tag,” said Xuesu Xiao, assistant professor of computer science and the team’s faculty lead. They had to fly a drone around to squirt water on their opponents’ ground vehicles while avoiding their own.

This year, instead of trying to shoot others down, they had to perform a rescue mission: Find a randomly assigned “survivor” in a field of battle and send first aid. The faster the find and the closer the kit, the higher the score.

“Our strategy was for a drone to scout the area first, find the target, and then drive another ground vehicle robot to deliver the first-aid kit,” said Xiao.

The team programmed six flying drones and a ground robot that communicated with one another—and nothing else. That means that the programmers had no immediate control over the vehicles; they set their autonomous creations free and hoped that they did a good job coding them.

Judges measure the distance from the target to the rover-delivered first aid kit. Photo by Jenn Pocock

Overall, their robots performed exceptionally, managing to cut their delivery time and distance to less than a minute and 57 inches, respectively. They were just nudged out, however, by first-place University of Southern Florida and second-place Virginia Tech.

“It was definitely very tight between the top three!” said Cameron Nowzari, associate professor in electrical and computer engineering. “There was only a two-point difference between first and second, and one point between second and third.”

Still, the team wasn’t disappointed with how they performed. Their robots were a labor of love, and they met the challenge in a big way.

In This Story

Xuesu Xiao

Sea life defended the republic

Jennifer Pocock — Tue, 29 Apr 2025 15:34:12 +0000

Sea life defended the republic Jennifer Pocock Tue, 04/29/2025 - 11:34

The bioinspired blimps performed swimmingly.

Blimp Squad members Elijah Pointer and Kareem Zaharan (seniors in mechanical engineering) reach for a balloon captured in Narly's net as Faculty Adviser Daigo Shishika looks on. Photo by Jenn Pocock

Narly glided toward the ceiling of 91��'s Life Science and Engineering Building aviary like a shiny beluga whale with undulating manta-ray wings and a rudder tail. Thomas Girois, a senior in mechanical engineering and Narly’s team lead, flipped on the blimp’s autonomous goal-seeking program to show off its ability to target airborne objects. He hopes it will head toward the balloon that he wants to capture. But it made an unexpected turn and instead nosed the high bay windows, where it wouldn’t move despite its programmed back-up function.

After a moment of confusion, Girois laughed. “It’s outsmarted us again!”

Narly’s microcontroller and camera was coded to recognize and hunt down green and purple airborne objects—which is exactly what it did when it registered the glowing green Exit sign on the ceiling outside the window. Still, the test boded well for the upcoming competition.

Narly was one of three sea life–inspired Lighter Than Air (LTA) vehicles to compete on George Mason’s Blimp Squad in the Defend the Republic (DTR) contest from April 21 – 25, 2025.

The Blimp Squad lines up with their devices, ready to go on the offense. Photo by Jenn Pocock

Flappy, another manta ray blimp, has a larger rudder tail that allows it to make pinpoint midair turns, and Knifey, inspired by the knifefish, has a long, undulating frill along its belly—and a fierce expression. These designs differ from their competitors’, which rely on propellers for propulsion and steering.

“Using propellers is easier,” said Daigo Shishika, assistant professor in the Department of Mechanical Engineering and one of the Blimp Squad’s faculty advisers. “But the big surface areas of our flapping wings are more efficient. Propeller-driven blimps need to carry more batteries, which are heavy and drain fast.”

Shishika noted that contestants lose points if they hurt another team’s blimp, which is always a risk with propellers.

Alexia De Costa (sophomore, computer science) follows under the fearsome Knifey, whose underbelly frill was inspired by the knifefish. Photo by Jenn Pocock

“We’re hoping to get more agility and a safer blimp,” he said.

Ningshi Yao, an assistant professor in the Department of Electrical and Computer Engineering and the squad’s other faculty adviser, also pointed out the blimps’ winning personalities. “Our flappies are pretty attractive robots,” she said. “Human-robot interaction is important. You want humans to like being around it!”

One DTR spectator, upon seeing Flappy fly for the first time, confirmed this theory. “It’s so cute!” she gasped. “I would die for Flappy.”

After hundreds of hours of testing, Narly, Flappy, and Knifey joined their two defense blimps—a zippy acrobatic wonder called Space Fish, and a high-scoring high-flier called Backbone Junior—to play a midair game of capturing balloons and releasing them through hoops to score goals.

Knifey's fierce expression intimidates the competition. Photo by:Jenn Pocock.

The team took third place out of six and scored the second-most points of all the teams.

“One highlight for me personally was that the flapping wing blimp achieved fully autonomous scoring for the first time since its first debut in the spring of 2023,” said Shishika. “It started as an exploratory agent that was primarily for research, but after two years and four competitions, Flappy finally contributed to the team by scoring 70 points.”

Narly also scored its first autonomous points.

While the team may not have taken first place, their sea-inspired research won the week.

Check out these shorts on our Youtube channel to see the vehicles and their designers in action.

In This Story

Daigo Shishika

lighter-than-air robotics

Electrical and Computer Engineering at George Mason

Topics

Electrical and Computer Engineering

competitions

mechanical engineering

Applied computer science

Mason's new MARC focuses on autonomy, robotics, and responsible AI

Nathan Kahl — Tue, 16 Apr 2024 14:30:37 +0000

Mason's new MARC focuses on autonomy, robotics, and responsible AI Nathan Kahl Tue, 04/16/2024 - 10:30

Industry executives, campus leaders, faculty, donors and alumni attended the official opening of 91��’s College of Engineering and Computing’s Mason Autonomy and Robotics Center (MARC), but the star of the show was a Boston Dynamics quadruped. As the bright yellow doglike robot held one end of the green ribbon, 91�� President Gregory Washington, MARC co-directors Professors Missy Cummings and Jesse Kirkpatrick cut. Afterward, the quadruped roamed the event, opening doors for attendees and demonstrating its capabilities.

The event showcased Mason’s strength in important, emerging fields. In his welcoming remarks, Dean Ken Ball said, “MARC is the focal point for our research in autonomy, robotics, and AI. Mason truly is a pace-setter in these areas.”

Attendees explored the new facility in Mason’s Research Hall on the Fairfax Campus. The space includes a 1,649-square-foot, two-story aviary for testing drones, areas for lab experiments, faculty offices, collaboration and study areas, and a student lounge.

Mason President Gregory Washington and MARC co-directors Missy Cummings and Jesse Kirkpatrick are aided by a Boston Dynamics "dog" in cutting the ribbon to open the center officially. Photo by John Boal Photography.

During her remarks, Cummings addressed the evolving role of robots in society. “People don’t want autonomy to do their creative jobs,” she said. “They want to do their art, they want to write their stories…what they want is the robot maid. Once we hit world peak population in 55 years, we won’t have enough people to do the jobs we need. The dull, dirty, dangerous jobs are a great place for robots.”

Both Ball and Washington noted that in addition to being a leader in artificial intelligence (AI), the university is focusing on responsible AI, with a graduate certificate in that field launching in fall 2024.

“We’ve been at the forefront of a whole host of outcomes and technologies that have benefited this state and this region," said Washington. "Right here in engineering, we established the first-in-the-country cybersecurity engineering program, so there’s a real lineage of innovation here. Mason will be the only Virginia university to join more than 200 of the nation’s leading AI stakeholders to participate in the Department of Commerce’s initiative to support the development of trustworthy and safe AI.”

“We do autonomy, we robotics, we do AI…but we do it responsibly and that’s in our core,” said Kirkpatrick. “It’s in our principles, policies, practice, and people. It’s across the research enterprise, and it’s in our teaching. The leaders of today, tomorrow, and the day after have to get this right because it’s so absolutely critical.”

Students demonstrate their claw game-like device, named Skygripper, to be used in the upcoming Defend the Republic competition. Photo by John Boal Photography.

Attendees explored the facility and talked to students about projects. Filling the MARC aviary for the event were student-designed “blimps.” These lighter-than-air creations will soon compete in Defend the Republic, an annual event in EagleBank Arena where the autonomous flying devices compete in a Harry Potter quidditch-like game to move a ball into a target hanging from the ceiling.

"Not just for engineering, MARC will be used by numerous colleges and departments across the university for many multidisciplinary projects. This is a collaborative space for our students to work,” said Ball. “And it’s really important they have the opportunity to work in close proximity to our faculty.”

MARC’s opening is another demonstration of Mason’s strength in STEM, which attracts numerous corporate partners. Venkat Potapragada of 22nd Century Technologies attended the event and said, “I’m here because this is a strategic relationship for us and a key component of our overall growth strategy. We depend on talent, and Mason will help us achieve our growth goals. In the D.C. region, Mason is a name to be reckoned with.”

Enroll in the Certificate for Responsible AI

Learn More About the MARC

Teaching humans to play safe

Nathan Kahl — Mon, 04 Mar 2024 21:02:44 +0000

Teaching humans to play safe Nathan Kahl Mon, 03/04/2024 - 16:02

Autonomous systems can be programmed to always make the logical, “best” decisions, given a set of circumstances. But what happens when human judgment and decision-making is introduced to a system? Xuan Wang, an assistant professor in 91��’s Electrical and Computer Engineering Department, is asking this question as part of a recent $344,000 grant from the National Science Foundation.

Wang stressed that this research is particularly important given technologies on the horizon. “The operation of many real-world systems involves the co-existence of human and autonomous agents. Inadequate coordination among these agents can lead to significant performance degradation or safety risks.”

Wang is turning the idea of humans controlling machines on its head. “The key novelty of this research is, instead of thinking about how humans can program robots, we are thinking about the ways that the autonomous agents can impact humans," he says. "Assuming human response can’t be coded in the way we can control a robotic agent’s behavior, then how we can design the robot’s behavior so they're impacting human behavior in a way that is beneficial for the overall system?”

In one of Wang's simulations, a human and robot carry a cup of hot water, testing programmed guarantees so that when the cup spills, it only spills to the robot side of the board, protecting the human. Photo provided.

Because human agents, who are very diverse, use observations to see occurrences in the world around them and respond accordingly, traditional optimization approaches are less effective at predicting behavior. Wang says that he’ll use a framework relying on game theory, which assumes each agent has their own objective function, and that function is coupled with another agent’s decisions and actions. Then both human and autonomous agents ideally will optimize their overall behavior to coordinate across a whole system, creating a better output.

This human-response alignment mechanism is bidirectional, allowing for communication moving in opposite ways at the same time. For robots, they will investigate new approaches that allow them to adapt more intelligently to human behaviors with uncertainties; for humans, they will study how they can be incentivized during human-robot interaction so that human responses favor the efficiency and robustness of the entire system.

But how can systems—autonomous or controlled by humans—ever guarantee safety, say in the use of unpersoned vehicles?

Wang says, “When we are deriving safety criteria, there might be some uncertainties, so given the inputs of the system there will be an upper and lower bound that allows you to know what is the worst case that will happen. Given that, if all assumptions are satisfied, one can guarantee that there will be no crash.”

Wang and team are also working with the Army Research Lab to develop collaborative autonomous vehicles working in unknown environments, ensuring the vehicles can coordinate and gain advantage when there are potential threats in the environment.

In This Story

Xuan Wang

Topics

Department of Electrical and Computer Engineering

human-computer interaction

Artificial Intelligence

National Science Foundation

Research

CEC faculty research

Tech Talent Investment Pipeline (TTIP)

TTIP

Tech Talent Investment Program

AI's future discussed at roundtable

Rena Malai — Tue, 13 Jun 2023 19:36:06 +0000

AI's future discussed at roundtable Rena Malai Tue, 06/13/2023 - 15:36

In This Story

Missy Cummings

Just what is AI? 

This was one of the first questions posed by Missy Cummings, director of 91��’s Autonomy and Robotics Center, at the Future of AI roundtable in June. 

“At the end of the day, AI can be a tool to help you in your job, but you need to understand both its strengths and weaknesses,” Cummings said. “That’s why Mason will be offering a certificate and master’s degree focused on responsible AI, so that people across industry and government can learn how to manage the risks while promoting the benefits of AI.”

The invite-only roundtable, hosted by the College of Engineering and Computing, explored the issues, challenges, and solutions to think about as AI technologies rapidly evolve and change almost as soon as they are introduced. 

Missy Cummings leads the Future of AI roundtable at Mason Square.

Cummings led the roundtable and highlighted AI areas like ChatGPT and autonomous driving systems that lack human reasoning skills. When human behavior, environment, and AI blind spots intersect, the resulting uncertainty contributes to fundamental limitations. 

“As humans, we do a great job of successfully filling in the blanks when there is imperfect information,” said Cummings. “If I quickly flash a picture of a stop sign, your brain automatically recognizes what it is, even if it’s not a clear image. But it’s arguable whether the vision system on a self -driving car can do the same.” 

She added that automation can fall apart at a critical threshold, such as when a car is supposed to stop at a stop sign that’s visible to the human eye, but maybe overlooked by an AI vision system. 

“As humans, we have much more experience driving cars,” she said. “Self-driving cars are still a new technology and while simulation testing can help identify problems, real-world testing for such non-deterministic systems that never reason the same way twice is critical.”

One of her favorite uses of ChatGPT is for her students to use it for grammar and spell checking when they write papers, but that’s the extent.  

“ChatGPT cannot reason under uncertainty. It does not think. It does not know. It can approximate human knowledge, but there is no actual thinking or knowledge,” said Cummings. “ChatGPT goes after the most probable image, or the most probable grouping of words.” 

In general, large language models like ChatGPT will use what the average person is saying on the internet. This means it could pick up extremist views, if it is currently something trending or popular online.    

It can also be a concern when it comes to diversity, she said. 

“If a company uses ChatGPT to write their mission statement, in another five years, everyone’s mission statement will be the same,” Cummings said. “Creative thoughts and authenticity are lost. It’s important to understand how far we push these models, and what the long-term ramifications could be.”

Roundtable attendees from local universities and tech companies left with a greater understanding of how AI can impact everyday life, in more ways than one.

Topics

Read the full article here.

Research

Mason Square

Washington Post quotes Missy Cummings on Tesla's Autopilot

Rena Malai — Mon, 12 Jun 2023 17:11:55 +0000

Washington Post quotes Missy Cummings on Tesla's Autopilot Rena Malai Mon, 06/12/2023 - 13:11

In This Story

Missy Cummings

A Washington Post article titled '17 fatalities, 736 crashes: The shocking toll of Tesla's Autopilot' quotes Missy Cummings, director of 91��'s Autonomy and Robotics Center, on the troubling surge in Tesla crashes.

"Tesla is having more severe — and fatal — crashes than people in a normal data set,” she said in response to the figures analyzed by The Post.

One likely cause, she said, is the expanded rollout over the past year and a half of Full Self-Driving, which brings driver-assistance to city and residential streets.

“The fact that … anybody and everybody can have it. … Is it reasonable to expect that might be leading to increased accident rates? Sure, absolutely.”

She says in the article the number of fatalities compared to overall crashes was also a concern.

Topics

In the Media

Electrical and Computer Engineering

Aspiring to smoother traffic

tdonnel — Fri, 02 Jun 2023 19:19:23 +0000

Aspiring to smoother traffic tdonnel Fri, 06/02/2023 - 15:19

In This Story

Brian Mark

There are few better feelings than hitting all green lights on your drive home. Brian Mark’s research aims to bring you that feeling more often. Ideally, technology can help you hit a “green wave” by keeping your car within an optimal speed bracket, says 91�� electrical and computer engineering professor Brian Mark.

The increasing likelihood of autonomous vehicles on the road offers a prospect even more promising than the idea of creating an app for human drivers, originally proposed in joint work of Mark and Melvin Friedman, a retired physicist from the Army Night Vision and Electronic Sensors Directorate in Fort Belvoir, Virginia. Through Mason's Office of Technology Transfer, Friedman and Mark submitted a U.S. patent application on a method for coordinating traffic lights and reducing traffic congestion.

“It probably will work even better with connected and automated vehicles,” explains Mark, “so you know the car itself is programmed to keep on the green wave. Like, if you have to turn right, you might not be on the green wave; so ... you might have to catch up to the green wave ahead of you or slow down to catch the green wave behind you.”

Mark supervised a senior design project to move toward his goal sponsored by the Army Strategic Program for Innovation, Research, and Employment (ASPIRE). Three George Mason Electrical and Computer Engineering Department teams participated in ASPIRE, supervised by Qilian Li, Brian Mark, and Cameron Nowzari, respectively. As part of the program, in addition to several Zoom meetings, the seniors attended a spring meeting at Fort Belvoir, Virginia, where they presented their project progress.

Mark’s ASPIRE team constructed a model of a connected and automated vehicle. Sara Sulaiman Alaraini, Colin Graves, Corey Jones, Nitin Mandadi, Andrew Mokhtare, and Adham Obeid modified a remote-control vehicle to operate autonomously on a tarp designed like a road system, complete with centralized traffic light–controlled intersections. The team outfitted the car with sensors, a camera, and arUco tags to help it stay oriented in its environment.

"The traffic lights are connected to a centralized server, and the car is able to automatically stop at a traffic light and then go when it turns green,” said Mark.

“Through the centralized server you can indicate the destination ... It will automatically calculate the path through the street grid, and the car will just go to that destination and obey all the traffic lights as it goes.”

Mark hopes a future senior design team can further extend the project by incorporating multiple cars to simulate traffic scenarios.

“The next project would be if you have a bunch of cars. And they're all following green waves, so that they're all obeying the traffic lights. But they never really have to stop unless they have to turn. That would be the ultimate demonstration of this concept.”

Topics

Electrical and Computer Engineering Faculty

Autonomous Cars

Research

patent

91�� wins Defend the Republic

Rena Malai — Mon, 22 May 2023 19:07:41 +0000

91�� wins Defend the Republic Rena Malai Mon, 05/22/2023 - 15:07

In This Story

Daigo Shishika

Patriot Pilots pose with their Lighter Than Air (LTA) creations. Photo by Ron Aira/Office of University Branding

Twice a year, university teams compete in the Lighter Than Air (LTA) Defend the Republic competition. In April, 91�� hosted the competition in EagleBank Arena and won. The winning Mason team, Patriot Pilots, led by principal investigators Cameron Nowzari, Ningshi Yao, and Daigo Shishika, all from the College of Engineering and Computing, competed against six universities and about 50 LTA robotic agents, aka blimps.

“Even after three years, I’m still in awe of what happens at this competition,” said Nowzari, who has led the competition for the past three years, will be moving on from the annual competition and leaving things in the hands of Yao and Shishika. “My hope is that this competition will continue, and more schools will get involved.”

The competition is a mix of technology and creativity, and something students seem to have a lot of fun with, according to Yao.

“The strength of our winning team was in the ability to think creatively through building and design,” said Yao.

Without the severity that can sometimes accompany other types of flying agents, blimps are a lighter, gentler kind of airborne machine that appeals to many people.

“Their soft body and low operational speed make them more tangible and accessible than drones or planes,” said Shishika. “At the same time, they bring unique and exciting research challenges that our students with diverse background tackle together.”

The team will schedule a kickoff meeting during the summer, to plan for the next competition in November. The team welcomes students from all majors.

“We’re always actively recruiting for the team,” Nowzari said. “All that you need to bring is your passion and creativity.”

For information on how to join, email dshishik@gmu.edu or nyao4@gmu.edu. People can also visit blimp-robotics.org to learn how to build their own LTA blimp and encourage younger students to do the same.

Topics

competitions

EagleBank Arena

Strategic Direction

Blimps set to battle at EagleBank Arena

Martha Bushong — Mon, 17 Apr 2023 13:00:24 +0000

Blimps set to battle at EagleBank Arena Martha Bushong Mon, 04/17/2023 - 09:00

Learn About the Robots

In the News

Patriot Profile: Dinesh Karri
April 24, 2023
Mason Engineering students and faculty compete at 99 Luftballoons competition
January 8, 2021

In This Story

Daigo Shishika

91�� is hosting a competition of lighter than air (LTA) robotic agents—“blimps,” colloquially—squaring off in the heights of EagleBank Arena on Friday, April 28, from noon to 2 p.m.

The “Defend the Republic” competition features teams from six universities competing in a series of events where aerial robots attempt to move balls through hoops suspended from the ceiling, while other robots try to thwart them. The purpose of the game and the research behind it is to develop the ability of LTAs to respond quickly in various situations where such a vehicle, with its ability to stay aloft for much longer than traditional aerial devices, is ideal – disaster recovery, reconnaissance, delivering aid, and more.

At the Friday session, as many as 50 robots will be simultaneously in the air, with students and faculty available to answer questions about their robots and research.

Faculty members Cameron Nowzari, Ningshi Yao, and Daigo Shishika serve as principal investigators and lead the group.

Topics

lighter-than-air robotics