数据库.md

数据库、数据仓库与数据建模

数据库与机器学习都是数据科学的主要部分。 数据库可以做在线分析处理(OLAP)。

数据需不需要持久化到数据库？ 大数据是机器学习必须的吗？ 数据存储与数据处理能不能在一起处理？ 分布式数据库与分布式机器学习如何结合起来？

数据科学的全流程管理，基于PCS的面向机器学习的便于决策的数据库。

1. 数据作为资产。
2. 数据驱动的决策与服务。
3. 数据密集的应用。
4. 实时计算。

• https://awesomeopensource.com/

Pravega

Pravega - Streaming as a new software defined storage primitive

• http://www.pravega.io/
• https://github.com/pravega/pravega
• https://moosefs.com/
• https://github.com/chrislusf/seaweedfs
• https://nutanixbible.com/
• https://awesomeopensource.com/projects/distributed-storage
• http://www.xtreemfs.org/

Analytics Zoo

• https://analytics-zoo.github.io/master/
• https://bigdl-project.github.io/0.10.0/
• http://rasbt.github.io/mlxtend/

alluxio

• https://www.alluxio.io/

Samsara

Samsara is an open source real-time analytics platform

• http://samsara-analytics.io/
• https://ssc.io/pdf/samsara.pdf
• https://zilliz.com/

Apache MADlib

Getting Started with Apache MADlib using Jupyter Notebooks We have created a library of Jupyter Notebooks to help you get started quickly with MADlib. It includes many commonly used algorithms by data scientists.

• https://madlib.apache.org/

Apache PredictionIO

Apache PredictionIO is an open source machine learning framework for developers, data scientists, and end users. It supports event collection, deployment of algorithms, evaluation, querying predictive results via REST APIs. It is based on scalable open source services like Hadoop, HBase (and other DBs), Elasticsearch, Spark and implements what is called a Lambda Architecture.

• https://github.com/apache/predictionio/
• http://predictionio.apache.org/

MLSQL

• https://www.mlsql.tech/
• https://github.com/allwefantasy/mlsql
• http://docs.mlsql.tech/zh/

SQLFLOW

• https://github.com/sql-machine-learning/sqlflow
• https://sql-machine-learning.github.io/

MLFLOW

• https://mlflow.org/
• https://www.mlflow.org/docs/latest/index.html

TFX

• https://github.com/tensorflow/tfx
• https://eng.uber.com/michelangelo-machine-learning-platform/

TDengine

• https://github.com/taosdata/TDengine
• https://zilliz.com/

DAO

• CME 323: Distributed Algorithms and Optimization

• http://www.cs.umd.edu/~bengfort/research/visualizing-distributed-systems/

• https://zenodo.org/record/1456199#.XsqJsWgzZPY

• http://www.reanahub.io/

• https://sites.google.com/view/icml-reproducibility-workshop/home

Spatial Database

• https://opengeohub.org/
• https://taiao.github.io/taiao/
• https://sites.google.com/view/ai3d2019/home
• https://www.esri.com/about/newsroom/arcwatch/where-deep-learning-meets-gis/
• http://mason.gmu.edu/~lzhao9/venues/DeepSpatial2020/
• http://cse.ucdenver.edu/~BSD2018/