Brian Schlining

Video Annotation Data Management (500055)

Imagine navigating a library holding not books, but 27,000 hours of underwater footage – that’s the challenge MBARI researchers face. Spearheading efforts alongside the team and MBARI’s video lab, Brian designs innovative systems to tame this ocean of data. His tools don’t just streamline internal workflows; they democratize deep-sea exploration by being freely available to other researchers worldwide. Through his open-source efforts, Brian empowers scientists everywhere to unlock the secrets hidden within every frame of MBARI’s vast video archive, propelling our understanding of the ocean’s hidden depths.

• MBARI Media Management (M3)

Unlocking the mysteries of the deep sea is bit easier thanks to MBARI’s Deep-Sea Guide, an invaluable resource for identifying and characterizing its enigmatic inhabitants. As the lead engineer, Brian provides support, development and updates to the Deep-Sea Guide.

• Public Deep-Sea Guide
• Internal Deep-Sea Guide
• New Deep-Sea Guide (pre-alpha)

For more information about running MBARI’s M3/VARS System, go to https://github.com/mbari-media-management/m3-quickstart.

Carbon Flux Ecology (902111)

Brian plays a role in two of MBARI’s core research programs analyzing still images. The first studies the vibrant diversity and ecological functions of deep-sea coral and sponge communities, vital residents of the Monterey Bay National Marine Sanctuary. The second program, unraveling the complex journey of biological carbon, tracks its transformation from the surface sunlit waters down through the ocean’s depths to the benthic communities of the seafloor. 

• Mondrian (A VARS Image Annotation Application)

Midwater Time Series (901221)

Between the surface of the sea and the ocean floor lies a vast fluid universe, Earth’s least-known environment. MBARI has sophisticated systems that have spent thousands of hours surveying and describing the deep waters of the ocean. In support of MBARI’s Midwater lab, Brian develops tools, technology, and analytical techniques for working with this large collection of data.

FathomNet (902002) and Ocean Vision AI (701165)

As the ocean reveals its secrets through cameras and sensors, researchers face a mounting challenge: a data deluge. Imagine sifting through countless hours of video footage, many frames teeming with fascinating marine life. Processing and analyzing this ocean of information quickly outpaces researchers’ abilities, hindering our understanding of this vital ecosystem.

This is where machine learning offers a glimmer of hope. Its algorithms can learn to identify patterns and extract insights from vast datasets, promising fast and sophisticated analysis of ocean imagery and video. But there’s a snag: machine learning needs reliable teachers. Without high-quality, well-curated data, these algorithms are like students given blurry textbooks – their results are muddled and unreliable.

Enter FathomNet, MBARI’s solution to this data dilemma. FathomNet is a treasure trove of expertly labeled underwater imagery, meticulously curated by scientists who know the ocean like the back of their hand. Each image in this database is painstakingly annotated, providing reliable data to train machine learning models.

FathomNet is more than just a collection of pictures; it’s a training ground for the future of ocean exploration. By feeding these high-quality images to machine learning algorithms, MBARI is helping to develop next-generation tools that can analyze ocean data with unprecedented speed and accuracy. Imagine autonomous underwater vehicles navigating coral reefs, automatically identifying and tracking marine life, or deep-sea cameras sending back real-time insights as they explore the ocean’s hidden depths.

Additional FathomNet resources:

– GitHub
– Medium
– Slack

Expedition Database Modernization (902403)

Picture a lush garden, verdant and vital, nurtured through sun, rain, and the dedicated care of a skilled gardener. Just like that garden endures changing seasons and evolving needs, so too does software require constant care and adaptation. This is especially true for critical platforms like MBARI’s expedition database, the backbone of research ship activities for decades.

Think of the expedition database as a meticulously organized treasure trove. It holds every detail of past voyages, from the chief scientist and mission goals to the ship’s instantaneous position, ROV movements, logistical notes, and even high-frequency environmental data like salinity, temperature, and pressure. It’s a historical tapestry woven with data, recording the whispers of the ocean captured during thousands of expeditions.

But like any garden, even the most meticulously maintained needs an occasional refresh. Technology blossoms rapidly, and MBARI’s expedition database now requires a two-pronged approach: future-proofing for ongoing maintenance and evolving to meet the changing needs of researchers. This isn’t simply about replacing aging tools; it’s about revitalizing the garden, planting new seeds of innovation, and ensuring that generations of researchers can continue to harvest the fruits of past expeditions and chart new courses of discovery.