Image
Image

Revolutionizing Health Research Through Real-Time Digital Phenotyping with Beiwe

Image
Image
Jump to
Discovery
Design
Develop
Grow
Image

Discovery

The Idea

Big data meets health care and treatment—that was the vision of Jukka-Pekka "JP" Onnela, PhD, when he conceived the Beiwe app. As the mobile component of the Beiwe research platform, it leverages modern smartphone technology to collect clinical study data. Rocket Farm Studios had the privilege of collaborating with Onnela to bring this app to life, creating a more efficient and effective way to gather crucial health information.

Onnela, a Fulbright scholar from Finland, now serves as an Assistant Professor of Biostatistics at Harvard University, where he leads the Onnela Lab. His research focuses on statistical network science and digital phenotyping. “We study social and biological networks, creating new mathematical models to understand them. Digital phenotyping is about using personal digital devices to quantify human behavior and social interactions in real time,” explains Onnela.

At its core, the Beiwe app aims to harness data to better understand human behavior. Onnela and his team identified a need for more accurate patient data collection, especially in healthcare settings. “Historically, collecting patient outcome data before and after treatment has been a challenge,” he says. By using smartphones to gather real-time data, Beiwe helps create digital phenotypes that provide valuable insights into patient behavior, particularly for those dealing with certain diseases.

“The idea is to move away from sporadic hospital visits and toward continuous data collection through digital ‘breadcrumbs.’ For instance, one of our collaborators, a neurosurgeon, can now monitor his patients before and after brain surgery with more data points, transforming these into biomedically useful information.”

Image
Our Strategic Approach
The challenge was to collaborate with 5 different companies to create an app, accounting for sheet music, digital rights, and a store.
While determining how to translate a sheet music store and playback to the iPad, we faced several engineering challenges.

  • The Notestar app integrated Yamaha’s eCommerce engine with Noteflight’s Publishing Server, as well as the Digital Rights Management servers for Hal Leonard and MusicSales.
  • Rocket Farm had to utilize the signal processing capabilities of the iPad to handle pitch correction and tempo changes on the iPad in real-time, so users could speed up or slow down playback to match their own speed.
  • Finally, there was the graphics processing — the display of music scores with advanced animation of page-turning, all tightly synchronized with the playback of one or more audio tracks.
Image

Image

Design

The Experience

The Experience

UI Design

When Onnela partnered with Rocket Farm Studios to develop the Beiwe iOS app, the design process was centered around simplicity. “We knew the app had to be easy to use, especially for patients who may have cognitive or physical impairments,” explains Onnela.

The app is designed to collect both passive data (like sensor-based information) and active data (through surveys), providing a comprehensive view of a patient’s cognitive and physical functions. "We monitor things like mobility, social interaction, and sleep patterns," Onnela notes. By using GPS and screen activity data, the app can even calculate time spent at home or analyze sleep behavior with remarkable accuracy..

Beiwe is also designed to track behavioral changes before and after medical treatments. “We can collect data months before an operation and continue for months after, giving us a much clearer picture of recovery than traditional methods,” says Onnela..

Privacy and security were critical from the outset. “We made sure that patient data was fully encrypted, with identifiers scrambled to ensure privacy,” Onnela explains. The app’s rigorous focus on security has led to approvals for use in over 10 studies, demonstrating its reliability and adherence to data protection standards.

Image
Image

Rocket Farm provided a thoughtful and innovative process that got us through a lot of design challenges in a short time. Their work on NoteStar demonstrates the ability to create products that are smooth running, innovative, and well designed.”

- Joe Berkovitz CEO of Noteflight

Image

Development

Making it work

Making it work

The development process required close collaboration between Rocket Farm Studios and Onnela’s back-end developers. The app had to interact seamlessly with Beiwe’s established platform while remaining customizable to fit the needs of different studies.

One key challenge was meeting the expectations of iOS users, which differ from Android users. “Rocket Farm helped us realize that simply copying the Android app over wouldn’t work. We had to design for the iOS experience,” says Onnela. Using Apple’s ResearchKit, the team optimized the user interface by displaying only one survey question at a time—a design choice that worked so well it was later adopted in the Android version too.

The player portion of the app handled scaling note sizes, allowing for changes in pitch and playback speed. The app had to support page-turning by both the user and the app when in playback mode.

There were also other unique interaction challenges: setting loop points to practice a section repeatedly, adding annotations to the score, and selecting different pitches. With all these , Rocket Farm undertook separate design phases.

The first was focused on the eCommerce store and the other on the playback experience. We actively tested user interactions as they were implemented. This approach was critical as these were ground-breaking features that required more than great paper designs, but the iterative incorporation of real user feedback to get it right.

Image

Rocket Farm Studios were extremely agile in how they presented and iterated on design – whether for the HTML5 store portion or the much more expressive set of interactions incorporated into the playback aspect of the app.”

- Joe Berkovitz CEO of Noteflight

Technology Used
Image
Digital Phenotyping & Data Collection
Image
Native iOS Development
Image
Apple ResearchKit Integration
Image
End-to-End Encryption & Data Privacy
Image

Grow

Where are they now?

Beiwe continues to be a crucial tool in numerous clinical studies, with its advanced data collection methods providing invaluable insights into patient care and behavior. As Onnela's lab grows, the app plays a central role in research that could redefine how healthcare monitors and treats patients in the future.

OVER
6,970,736
ACtive Users

Ready to build something amazing ?

LET’S TALK
Image