Skip to content

Latest commit

 

History

History
159 lines (116 loc) · 9.27 KB

README.md

File metadata and controls

159 lines (116 loc) · 9.27 KB
Raw

A Comprehensive Synchronization by Deriving Fluent Pipeline for Emergency Services and Healthcare using Natural Language Processing

2020 has been a rough year. We started with a wildfire in Australia , saw half of our world die due to COVID, migrant workers moved across states in our country,skies in California turned orange as the state choked up the fire fumes and what not. We have faced every calamity possible in this year and we , Team Myth Busters think , it would be stupid not to prepare ourselves for the future. So, lo and behold , Emergency Ally, a smart website designed to always be there for you in the time of emergency and get you out of it as soon as possible.

Built using Natural Language Processing and Machine Learning,Emergency Ally is a Comprehensive Web App which can help you provide SOS or Emergency Level Solutions , In Case You encounter or see someone in any Danger or Disaster Situtations.

Functionalities

  • Input Emergency
  • Classification of emergency:Classifies your emergency to a bunch of other related emergency types
  • Priority Sorting:our model understands how urgent your search is and assigns it a priority level
  • Location Based Results:Gives you location based suggestions of nearest help centers and their contact information.

The goal of this project is to apply the data engineering skills learned in the course to analyze disaster data from Figure Eight to build a model for an API that classifies disaster messages. The project is divided in three sections:

  • Data Processing: build an ETL (Extract, Transform, and Load) Pipeline to extract data from the given dataset, clean the data, and then store it in a SQLite database
  • Machine Learning Pipeline: split the data into a training set and a test set. Then, create a machine learning pipeline that uses NLTK, as well as scikit-learn's Pipeline and GridSearchCV to output a final model that predicts a message classifications for the 36 categories (multi-output classification)
  • Web development develop a web application to show classify messages in real time

Software and Libraries

This project uses Python 3.7.2 and the following libraries:

More informations in requirements.txt. To create it I have used python -m pip freeze > requirements.txt. To install all Python packages written in the requirements.txt file run pip install -r requirements.txt.

Data

The dataset is provided by Figure Eight is basically composed by:

  • disaster_categories.csv: Categories of the messages
  • disaster_messages.csv: Multilingual disaster response messages

Running the code

From the project folder run python dash_disaster_response_pipeline.py to start the dash application. The default url to connect to it is http://127.0.0.1:8050/.

|-- disaster_response_pipeline_project
    |-- disaster_response_pipeline
    |   |-- data
    |   |   |-- ETL Pipeline Preparation.ipynb
    |   |   |-- process_data.py    
    |   |   |-- disaster_categories.csv 
    |   |   |-- disaster_messages.csv     
    |   |
    |   |-- classifier
    |   |   |-- ML Pipeline Preparation.ipynb
    |   |   |-- train_classifier.py
    |   |   |-- trained_classifier.pkl
    |   |
    |   |-- disaster_response_pipeline.py
    |   |-- dash_disaster_response_pipeline.py
    |
    |-- db.sqlite3
    |-- db_dump.txt
    |-- README.md

If the application does not find the trained_classifier.pkl pickle file to load the model it will check also if the database db.sqlite3 present and if not process the data and finaly train the model (save it in classifier/trained_classifier.pkl) to get the application ready to classify messages in real time.

Flowchart

Flowchart made using draw.io

All the modules provide the help funcionality provided by argparse module.

By default the GridSearchCV for the best parameters for the model is disable because of the long time required to perform it. To perform it run train_classifier.py with the option --grid_search_cv

Using sqlite3 command shell is possible to extract a dump of the database if needed:

sqlite3 db.sqlite3

sqlite3> .output db_dump.txt

sqlite3> .dump

sqlite3> .quit

Results and Preview

The dash application

Home

Result -

Finding nearby emergency services using automation -

As shown in the Overview of Training Dataset section the dataset is highly imbalanced and that is the reason why the accuracy is high and the recall value is pretty low. To tackle and imbalanced dataset there are a lot of ways as shown in this really intresting post

Category Precision Accuracy Recall F1-score Support
related 0.83 0.79 0.37 0.51 1123
request 0.00 0.87 0.00 0.00 30
offer 0.74 0.99 0.52 0.61 2711
aid_related 0.53 0.72 0.06 0.11 504
medical_help 0.65 0.92 0.06 0.11 326
medical_products 0.62 0.95 0.09 0.15 171
search_and_rescue 0.33 0.97 0.01 0.02 120
security 0.54 0.98 0.09 0.15 232
military 0.00 0.96 0.00 0.00 0
child_alone 0.83 1.00 0.19 0.31 398
water 0.82 0.94 0.35 0.49 700
food 0.81 0.92 0.25 0.38 580
shelter 0.67 0.92 0.12 0.20 102
clothing 0.62 0.98 0.03 0.06 148
money 0.50 0.97 0.04 0.08 70
missing_people 0.29 0.98 0.01 0.02 203
refugees 0.84 0.96 0.18 0.29 291
death 0.40 0.96 0.02 0.04 861
other_aid 0.60 0.86 0.01 0.01 419
infrastructure_related 0.66 0.93 0.07 0.13 292
transport 0.76 0.95 0.10 0.18 343
buildings 0.44 0.95 0.06 0.10 140
electricity 0.00 0.97 0.00 0.00 44
tools 0.00 0.99 0.00 0.00 57
hospitals 0.00 0.99 0.00 0.00 30
shops 0.00 0.99 0.00 0.00 87
aid_centers 0.40 0.98 0.01 0.01 280
other_infrastructure 0.85 0.95 0.49 0.62 1838
weather_related 0.92 0.83 0.32 0.47 528
floods 0.79 0.94 0.27 0.40 595
storm 0.00 0.92 0.00 0.00 69
fire 0.90 0.98 0.56 0.69 638
earthquake 0.84 0.95 0.12 0.22 128
cold 0.60 0.98 0.05 0.08 328
other_weather 0.82 0.95 0.31 0.45 1293
avg / total 0.72 0.93 0.29 0.39 15679

TODO

  • 0 - Delete this TODO section when all the tasks are working properly
  • 1 - In disaster_response_pipeline.py: check if table is present in the database

Licensing and Acknowledgements

Thank you Figure Eight for the datasets and more information about the licensing of the data can be find here.