By Tyrone Burke
Photos by Fangliang Xu
The is only about an hour鈥檚 drive west of Ottawa, but on a brilliant autumn morning, the city feels a world away.
The 47-hectare mix of forested woodlands and wetlands is bursting with crimson and gold, with reflections of towering maples and a cloudless sky shimmering in the glassy back bays of the Ottawa River. And even though it doesn鈥檛 look the part, Morris Island is a stand-in today for distant James Bay, which stretches south from Hudson Bay about 1,000 kilometres north of the National Capital Region.
Jeremy Lalibert茅 (left) and Gerhard Bruins.
Backed by low-lying marshland, James Bay is sparsely populated and lined with broad beaches and nutrient-rich mudflats. It鈥檚 an ideal place for more than two dozen species of shorebirds to rest and feed before they continue their epic migrations.
Every summer, a team of volunteers travels to this roadless region; they count shorebirds by walking back and forth on transects that run perpendicular to the shore 鈥� about 10 kilometres each day 鈥� noting which species they spot and how many there are. But this type of survey can be invasive, disturbing birds such as the endangered red knot 鈥� a hefty, long-legged sandpiper that flies to Tierra del Fuego at the tip of South America 鈥� and adding risk to southbound journeys on which they must navigate coastal habitats damaged by ports, resorts and urban development.
Which is why one of those volunteers, Gerhard Bruins, asked an engineer at 杏吧原创 how the bird counts could be made more comprehensive, accurate and efficient. And why a small group of professors and students have gathered at Morris Island to test fly a new approach.
Using Drones to Enhance Wildlife Conservation
At the conservation area, master鈥檚 student Brendan Ooi is tiptoeing along the water鈥檚 edge, planting hyper-realistic 3D-printed models of shorebirds including red knots and greater yellowlegs among the rocks. Overhead, a small drone is hovering. The low buzz of its rotors is interrupted only by the clicks of its integrated camera system and the occasional splash of a Canada goose coming in for a landing.
The drone is piloted by Mechanical and Aerospace Engineering professor Jeremy Laliberté, Ooi鈥檚 academic advisor and one of the country鈥檚 leading autonomous aerial systems researchers.
Brendan Ooi
Laliberté and Ooi are working out how best to use aerial photography to count birds on the ground. They鈥檙e taking photographs and video footage of these model birds from different elevations to determine the optimal balance between covering terrain and accurately identifying birds.
鈥淲e鈥檝e been trying to find the ideal flight path,鈥� says Ooi.
鈥淲e want to know whether it鈥檚 better to fly in a grid pattern or in a line. We want to automate the image taking and video recording process, so a drone can be set up in advance and is easy enough to use that the volunteers can go north and run the bird count program even with little or no experience flying drones.鈥�
But automating drone operations is one thing; processing the imagery is another. 鈥淪ometimes you can collect too much data,鈥� says Ooi, 鈥渁nd you don鈥檛 know what to do with it.鈥�
A Creative Collaboration Between Engineers and Biologists
That鈥檚 where comes into the picture. The Systems and Computer Engineering instructor was the first person approached by Bruins, a former Canadian Wildlife Service scientist and director of the ecological consulting firm , who has travelled to James Bay three times to count shorebirds the old-fashioned way.
Schramm recognized that the bird counting process could be automated by training a neural network to recognize aerial images of shorebirds 鈥� and that the artificial intelligence application could process this visual data much more efficiently than humans. But getting that information into a format the neural network can handle is an additional challenge, and two of Schramm鈥檚 fourth-year computer science students are working to solve it.
Simon Dewilde and Rachel Myrah are developing a photo stitching system that will merge the imagery captured by the drones into larger files and automatically eliminate the overlap between images. They鈥檝e also started training a neural network to recognize shorebirds, so they can automate the process of counting birds in those stitched-together panoramas.
鈥淲e want to automate as many of the steps as possible,鈥� says Dewilde, 鈥渢o reduce the amount of human effort required. People have to go out there for weeks at a time and can be in dangerous situations when they do.鈥�
Dewilde and Myrah are striving to make a system that can count birds at least as accurately as people can, while allowing volunteers to stay close to the hunting camps they rent from local First Nations during these annual counts (and far from any polar bears that happen by). But training a neural network to recognize and classify features in images can take thousands of photos; each classification can require a thousand images. And when you鈥檙e dealing with rare or endangered birds, there aren鈥檛 thousands of photos to choose from, especially from an aerial perspective.
鈥淚t requires a ton of data,鈥� says Myrah. 鈥淩ight now, we鈥檙e getting sample images, and even though they are not actual birds, they鈥檒l let us train the neural network, which will hopefully enable us to count the real birds.鈥�
Realistic 3D-Printed Birds Help Train Neural Network
For this approach to work, the model birds needed to be realistic. And for that, the researchers turned to biology professor Jeff Dawson.
鈥淲e collected photographs of the different shorebird species,鈥� says Dawson, who worked with undergraduate computer science student Skyler Bruggink to create the digital models.
鈥淭o make sure we had modelled the birds accurately, we compared the 3D models to actual taxonomic specimens and made sure they had accurate dimensions and attributes.鈥�
Skyler鈥檚 father Ed Bruggink, a wildlife artist who has managed the biology department鈥檚 greenhouses for nearly 40 years, then painted the models to give them a lifelike look and feel.
For ease of use, Laliberté chose to work with an off-the-shelf platform. The DJI Mavic 2 is a small quadcopter with a high-quality integrated camera. It鈥檚 a widely used aircraft for drone photography. By using a ready-made setup, Laliberté and his team could focus on how best to collect the data, rather than having to build a drone or design a photography system for one.
As Ooi places the model birds among the rocks on the sandy shores at Morris Island (whose maple trees belie the simulation of sub-arctic tundra), he notes that even if all the technical hurdles can be overcome, there will be one more challenge: not disturbing the living, breathing birds that are sharing Morris Island鈥檚 airspace with the drone.
鈥淭he biggest issue is how they react,鈥� he says.
鈥淚f the birds don鈥檛 like you, you can鈥檛 really do this. If they stopped flying, we wouldn鈥檛 fly either.鈥�
Wednesday, January 22, 2020
Share: ,
