BUTLER Smart Health Trial

Tecnalia has deployed a joint smart-health and smart-home field trial. Its purpose was demonstrating that the integration of several third party IoT services already developed into BUTLER platform was not only easy and seamless but mutually beneficial. Tecnalia’s services for this scenario have been the following.

SmartHealth services and devices provided by Tecnalia for BUTLER field trials:

  • GPS-enabled Fall Detector,
  • Emotion Detector,
  • Medication Assistant,
  • TV-based telecare service,
  • User-adapted Videoconference for Psychotherapy,
  • OSGI framework as gateway to the BUTLER platform.

Besides, and to be fully BUTLER compliant, a new web based on SmartMobile framework has been developed. It is targeted to complementary users (relatives, healthcare professionals), to retrieve relevant information from BUTLER platform once the healthcare services’ primary users (patients) have introduced it.

  • Latest version ID: 1.0
  • Tags: , , , , , , , ,
  • Latest update: November 14, 2014
  • Developed by: Tecnalia
  • Relations:
    • SAMURAI: A Streaming Architecture for Mobile and Ubiquitous RESTful Analysis and Intelligence (more details)
      • Relation type: Re-use relationship
      • Validation: When participants are indoor, the coordinates are also sent to the User Behavior manager. As an answer, Tecnalia’s OSGI framework receives a semantic location of the position, i.e., the name of the room where the participant is currently standing. This semantic location is shown on the smart mobile application, and it is more comprehensible than the raw position coordinates. The reliability of the Behavior Manager was very high during the trials, considering that the semantic location had to be obtained immediately in order to be handled by the Smart Mobile application, so that intelligible information about the participant location could be read on the screen.
      • Completeness of the relation: 100%
    • BUTLER Multimedia SmartServer (more details)
      • Relation type: Re-use relationship
      • Validation: Tecnalia had developed a system to display messages on the TV, but this system was using an obsolete DVB set-top-box, before smart TV’s were available in the market. That’s why the Multimedia server has been utilized. This server is used to show information related to participants’ medication: the intake action, the name of the medication, the dose and the timestamp are shown on the screen. Tecnalia’s OSGI framework receives all this information from the medication devices used by participants. This information is registered and redirected to the Multimedia server, indicating the TV device where it has to be shown.
      • Completeness of the relation: 100%
    • BUTLER Device Data eXchange (DDX) (more details)
      • Relation type: Re-use relationship
      • Validation: The DDX receives all data from Tecnalia’s OSGI framework and provides the underlying API that has been used to build the smart mobile application. All queries done in this application are directed through this API so that the DDX server can be reached and the data can be obtained and shown to the final user. It is remarkable the flexibility of the DDX API to handle its stored data that has been previously sent. The available filters to handle the information are highly configurable and very useful to limit the range of data that is shown on the Smart Mobile application. On the other hand, the filters act quickly and there is no noticeable delay for the final user.
      • Completeness of the relation: 100%
    • BUTLER Localization Manager SmartServer (more details)
      • Relation type: Re-use relationship
      • Validation: Tecnalia’s OSGI framework sends the position of the participants to the Location Manager. When they are outdoor, the coordinates come from the fall detection device (latitude, longitude). When participants are indoor, the coordinates come as “x, y, z” values, and are provided through ZIGPOS Gateway. All these values are provided using the Location Manager RESTful API. During the trials, the simplicity of the RESTful API made easy the Location Manager integration. Besides, data was sent only in one direction, from Tecnalia’s OSGI framework to the Location Manager, so that there was no delay in the rest of processes that Tecnalia’s framework had to perform, especially the subsequent connection with the DDX server to re-send the obtained location data.
      • Completeness of the relation: 100%
    • Smart Health (more details)
      • Relation type: Reference relationship
      • Validation: This deployment reference several scenarios of the Smart Health use case.
      • Completeness of the relation: 100%
    • Smart Living (more details)
      • Relation type: Reference relationship
      • Validation: This use case is linked with Smart Living solutions
      • Completeness of the relation: 50%
    • sensiNact (aka. BUTLER Smart Gateway) (more details)
      • Relation type: Re-use relationship
      • Validation: The BUTLER Gateway was used in conjunction with the fall detection device, in order to identify the real position of two particular events when they occured indoor: fall events and “panic button” events (when the participant wearing the fall detection device pressed the panic button). As the fall device only detected GPS coordinates (i.e., outdoor positions), ZIGPOS devices worn by participants indicated the indoor position (x, y and z coordinates), so that they could be detected in case of fall or panic situation. With the help of the Behaviour User Manager, the position was semantically translated to make it legible on the Smart Mobile Application. The ZIGPOS SmartObject Service of the BUTLER Gateway offered good precision, with real time updates of participants’ position, which only had to wear very small indoor location devices. The deployment of the beacons was very fast, in unobtrusive locations, and covering an appreciable area with a small number of them.
      • Completeness of the relation: 100%
    • BUTLER User Feedback Tool (more details)
      • Relation type: Re-use relationship
      • Validation: The User Feedback tool has been reused in the Smart Health deployment to gather end user feedbacks.
      • Completeness of the relation: 100%

Intellectual property rights (IPR)

@BUTLER

General Description of the Trial

Tecnalia has deployed a joint smart-health and smart-home field trial. Its purpose was demonstrating that the integration of several third party IoT services already developed into BUTLER platform was not only easy and seamless but mutually beneficial. Tecnalia’s services for this scenario have been the following.

SmartHealth services and devices provided by Tecnalia for BUTLER field trials:

  • GPS-enabled Fall Detector,
  • Emotion Detector,
  • Medication Assistant,
  • TV-based telecare service,
  • User-adapted Videoconference for Psychotherapy,
  • OSGI framework as gateway to the BUTLER platform.

Besides, and to be fully BUTLER compliant, a new web based on SmartMobile framework has been developed. It is targeted to complementary users (relatives, healthcare professionals), to retrieve relevant information from BUTLER platform once the healthcare services’ primary users (patients) have introduced it.

Trial Scenario

A sample scenario is presented in the Examples section

GPS-enabled Fall Detector and Outdoor Locator

This is a portable device, hanging from the waist, which can detect a fall and then establish a hands-free phone call or send a SMS providing GPS location to a pre-configured phone number. It can also register and send to the cloud periodically GPS position independently of a fall detection. It communicates with a Google App Engine where all this data are registered and where our OSGi framework takes the information from. It can also manage and report remotely about battery charge state and device state (on/off).

Emotion Detector

This is a service which continuously communicates via Bluetooth measurements from a wearable heart-rate monitor to a smartphone. This latter one processes the information received and outputs the emotional valence (positive or negative –i.e., stressed) of the wearer.

Medication Intake Assistant

This is basically a smartphone and a netbook (both complemented with a NFC-reader and voice output) which can read NFC-tagged medications assisting the elderly person on the name of the medication (it was originally designed for visually impaired people). Besides, netbook has extended functionality and can inform about medication’s expiring date, the correct dose and medicine and the right moment for the intake, according to a plan for medications included.

TV based Telecare Reporting Service

This TV-based telecare service is basically a vital signs tele-reporting and messaging service. Unfortunately, this is a product for rural area citizens –handicapped for being far away from municipality services and having old multimedia equipment at home-, developed over a set-top-box (STB), an old device to receive TDT (digital television) over old TV sets, currently obsolete and out-of-the-market because of the boom of smartTVs. Programming on that STB, we could show reminders and telecare information on the TV set, overlapping on a corner of the channel programme. In the same way, the elder at home can send vital sign information obtained through Bluetooth medical devices: digital scale, pulse-oximeter and tensiometer.

User adapted videoconference for psychotherapy

This service remotely connects a therapist with an elder person suffering stress, sadness or similar and requesting for a psychotherapy session. It employs desktop computer at both sides, a standard one at the side of the therapist and a tactile-adapted one at the side of the elder. It doesn’t make use environmental information to be executed.

OSGi Framework

Finally, all the devices and information from aforementioned services are to be connected and integrated into an OSGi-based framework developed by Tecnalia. This framework acts as a middleware helping us to collect relevant and objective information from smart devices and services to be later persistently stored and potentially processed and enriched transforming ‘technologic information from sensors’ into ‘end-user terminology’, basically related to daily life of the person (activity, behaviour, physical and emotional health, etc.). This way, this middleware also helps to unify a data model for device and applications data strings and, consequently, to simplify transmission and parsing processes.

Overall Architecture

This overview is a brief summary of a profound reflection addressing the best (cheapest and easiest) manner for integration into BUTLER platform when third-party services, already developed and running in the market (as Tecnalia’s are), want to take profit from BUTLER capabilities.

Trying to apply some criticism to integration tasks from the point of view of a third party trying to integrate released services into BUTLER platform, we analyzed different ways for the integration with the BUTLER platform, basically two, first through the Smart Gateway and then through some of the Smart Servers.

On the one hand, we analyzed the integration through the Smart Gateway. About this, we’d like to remark firstly that Tecnalia’s devices (basically, medical devices:ECG, digital scale, pulse-oximeter and blood pressure monitor) are not stand-alone devices but seamlessly integrated with smart-health applications through proprietary communication protocols. The Non-Disclosure-Agreements signed with devices’ manufacturers don’t allow us to use these proprietary protocols in other ‘public’ applications but our OSGi framework, what is already being done. Besides, this integration means provided more added-value for Tecnalia. On the other hand, this OSGi framework also provided a seamless connectivity with BUTLER Smart Server for all the smarthealth services’ information. Tecnalia may lose BUTLER capabilities for security access provided by Smart Gateway but somehow this requirement was covered adequately by our OSGi framework as well and ethical procedures.

Furthermore, that device integration job seemed to be not worthy not only from the ‘business’ point of view of a company with an already-finished application –searching for the easiest and more profitable way to integrate and benefit from that integration (Tecnalia’s case, and hopefully many more in the future)- but also considering our role in the project, which was namely to work on WP5 for field trials after an easy integration.

On the other hand, the OSGI framework had some RESTful APIs already built and apparently easy to work with, for the integration with some of BUTLER Smart Servers. Consequently, Tecnalia’s plan was to integrate directly through most interesting Smart Servers for us, this is, throughout DDX, Location Manager and Multimedia Servers (this latter was at lab demonstrator, not for real field trials), Smart Gateway instead.

This approach was beneficial for both, BUTLER and Tecnalia, considering a BUTLER customer role for the latter. To clarify this concept we’d like to say that obviously it comprises ideas concerning the alignment with Tecnalia’s global strategy but it’s mostly devoted to the vision of a third party company with already released products and services wanting to take profit of the integration of their assets into the BUTLER platform. Consequently, take them as advantages or benefits for future companies that may want to take profit linking their IoT-based products and services into a relevant scalable and interoperable platform as BUTLER wants to be shown in the market.

butlersmarthealth

Service level

This first description of the BUTLER smart health deployment was updated by the end of the trials in September 2014.

The deployments will continue to be maintained and updated by the responsible partners beyond the end of the project.

Technology Readiness Level

6 - technology demonstrated in relevant environment

Reuse Readiness Levels

4 - Reuse is possible; the software might be reused by most users with some effort, cost, and risk.

Security

A security assessment of the trial has been done and will be published soon

Jon lives in the centre of Bilbao with his wife and two daughters, aged 12 and 17. He is 55 years old and works for a technology-based company oriented to the health market. The company is located in a village 15 km away and he usually drives there every day in his own car. His job at the company has increased in competences and responsibilities during the past two years and he has to spend more hours than ever before in front of a desktop computer. This situation is producing some top back pain episodes and at the same time becoming quite stressing for him. As a consequence of it he feels emotionally altered even when being at home with his family.

His wife is worried about Jon and suggested him to pay a visit to the doctor. After a clinical review and due to his back pain he presents some symptoms of osteopenia (early stage of osteoporosis) and the doctor suspects Jon is at risk of suffering falls. During that clinical review and at several moments, Jon presented anomalous high measures for blood pressure. He tells Jon that the reported stressing situation at job is probably producing that eventual point of hypertension. However, Jon reports that but there is some background of that pathology at his family of this pathology. The doctor gives some advices to follow when feeling stress situations and recommends taking blood pressure measures periodically to follow up the evolution of such hypertension episodes. He even suggests Jon to take some medications like Lisinopril to help controlling that evolution.

Next day, having lunch with his boss at work, Jon comments to him main aspects of that clinical review. Then the boss suggests him to test in his real environment some recent smart e-Health services developed within the company that may help him with so many health concerns.

Concretely, for hypertension management he suggests to take home both a Telecare Reporting Assistant system using his TV set (to be reminded and to send the doctor at the company blood pressure measures periodically) and a Medication Intake Assistant system (which would help him to check the medication: Lisinopril package, dose and moment of the day for the intake).

To control stress episodes, he suggests using a recently developed Emotional Detector based on a wearable heart rate monitor connected to Jon’s smartphone where an app evaluates the level of stress. Jon can use it at potentially risk situations like driving but his boss recommends him to use it continuously while working. That way, he can be noticed at any moment and, when alerted of an emotional unbalance, then make use of a new smart service of the company, a Videoconference Service for Psychotherapy, providing adaptive sessions with the doctor of the company to proceed with a table of respiratory and physical exercises. That will help him to relax.

Due to Jon’s risk of falls, the boss recommends him to use a wearable Fall Detector device that can warn the person he decides sending immediate information about the exact outdoor location he is if he suffers a fall.

Besides the help this devices and services, individually, can provide him, the boss tells Jon that there is an added value service: his laptop for tele-working will include a tool for collecting information from all the services. A recent agreement between the company and BUTLER consortium permits now a seamless connection between their information collecting tool and BUTLER IoT platform. That agreement includes a set of BUTLER-enabled indoor locators for any person at the company agreeing to take profit from BUTLER-enabled services. This brings more benefits for Jon’s sake: more people than those enabled (but limited) by company’s tools can subscribe to the information he generates, for example, his family doctor who is doing the follow-up, the doctor of the company and relatives. Furthermore, his fall detector now can also be useful at indoors (sending indoor location) when a fall may occur, if he agrees to wear and place some small BUTLER devices (indoor locators) in his pocket, at home and in the office. A new internal tool at BUTLER platform could also in the future correlate emotionally unbalance episodes with falls, and then be informed for prevention. The Telecare Reporting Assistant tool is prepared for his old TV set with cathode ray tubes, just changing his external Set-top-box with a programmable one the company used to develop that service. But Jon notices his boss that his daughters are pressing to substitute that obsolete TV set with a modern smartTV, and he and his wife are seriously considering that option. He is afraid that such telecare will not be useful in they make a decision of changing TV. The boss calms him down: the collecting tool at his laptop is already prepared to receive reminders and send the medical devices measurements without the usage of that programmable set-of-box and ready to be shown on his new smartTV thanks to BUTLER platform functionalities. Jon is delighted with his boss’ proposal and accepts to give it a try, installing all the company’s stuff at his home cloud-connected to BUTLER platform services, basically indoor locators and collecting tool. He also agreed to wear permanently a fall detector device and a heart rate monitor belt for stress follow-up, BT-connected to his smartphone. His family doctor also accepted to subscribe to all the information Jon provides to BUTLER platformthrough its DDX SmartServer, and he installed in his smartphone and notebook a BUTLER SmartMobile-enabled set of services to check blood pressure evolution, medication intake, falls and stress episodes. So they did Jon’s wife and oldest daughter, who also installed that BUTLER’s SmartMobile-enabled service in their smartphones to be aware of any fall. Finally, Jon’s company doctor subscribed too, but in this case to the emotional detector information so then he can be noticed when to suggest a psychotherapy videoconference with Jon. Also Jon’s boss is alerted about possible work overload producing such stress.

Jon, his wife, oldest daughter, family doctor and physician at the company are using the company health services, which are BUTLER-enabled, since six months ago. All the information related to his potential hypertension (adherence to Lisinopril treatment –through Medication Intake Assistant- and blood pressure evolution –through Telecare Reporting Assistant- is followed up periodically by his family doctor without asking him to pay any visit. The doctor, besides, has a chance to remind Jon remotely that he has to take some health measures to be later reported to him –through Telecare Reporting Assistant-. Jon takes it medicine daily as prescribed and family doctor can know it through Medication Intake Assistant. Now, Jon needs to go to the doctor only for new prescriptions of Lisinopril since the doctor checks once a week that blood pressure evolution is stable at its normal values. Except for last week, when the family doctor detected slightly high values for blood pressure and sent a reminder to Jon’s TV set to go to clinic for a quick check and adjust Lisinopril medication dose –everything through Telecare Reporting Assistant-. A fall event –through Fall Detector- was detected a week ago when going to take a coffee downstairs at company’s premises. His daughter was immediately warned by BUTLER fall subscription service at her mobile so she could phone him at once in order to know that no hazard occurred. Jon’s stress peaks are slowly disappearing since his company doctor is acquainted immediately of any new episode and can establish a psychotherapy videoconference with him, what is appearing to be very relaxing and comfortable for him.

Since Jon is making use of all aforementioned smart IoT services, he feels better because he knows he is continuously monitored and followed-up by experts. It also provides peace of mind to his wife.