Teste_08.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "\n",
        "# Partial Dependence Plots\n",
        "\n",
        "\n",
        "Partial dependence plots show the dependence between the target function [2]_\n",
        "and a set of 'target' features, marginalizing over the\n",
        "values of all other features (the complement features). Due to the limits\n",
        "of human perception the size of the target feature set must be small (usually,\n",
        "one or two) thus the target features are usually chosen among the most\n",
        "important features.\n",
        "\n",
        "This example shows how to obtain partial dependence plots from a\n",
        ":class:`~sklearn.neural_network.MLPRegressor` and a\n",
        ":class:`~sklearn.ensemble.GradientBoostingRegressor` trained on the\n",
        "California housing dataset. The example is taken from [1]_.\n",
        "\n",
        "The plots show four 1-way and two 1-way partial dependence plots (ommitted for\n",
        ":class:`~sklearn.neural_network.MLPRegressor` due to computation time).\n",
        "The target variables for the one-way PDP are: median income (`MedInc`),\n",
        "average occupants per household (`AvgOccup`), median house age (`HouseAge`),\n",
        "and average rooms per household (`AveRooms`).\n",
        "\n",
        "We can clearly see that the median house price shows a linear relationship\n",
        "with the median income (top left) and that the house price drops when the\n",
        "average occupants per household increases (top middle).\n",
        "The top right plot shows that the house age in a district does not have\n",
        "a strong influence on the (median) house price; so does the average rooms\n",
        "per household.\n",
        "The tick marks on the x-axis represent the deciles of the feature values\n",
        "in the training data.\n",
        "\n",
        "We also observe that :class:`~sklearn.neural_network.MLPRegressor` has much\n",
        "smoother predictions than\n",
        ":class:`~sklearn.ensemble.GradientBoostingRegressor`. For the plots to be\n",
        "comparable, it is necessary to subtract the average value of the target\n",
        "``y``: The 'recursion' method, used by default for\n",
        ":class:`~sklearn.ensemble.GradientBoostingRegressor`, does not account for\n",
        "the initial predictor (in our case the average target). Setting the target\n",
        "average to 0 avoids this bias.\n",
        "\n",
        "Partial dependence plots with two target features enable us to visualize\n",
        "interactions among them. The two-way partial dependence plot shows the\n",
        "dependence of median house price on joint values of house age and average\n",
        "occupants per household. We can clearly see an interaction between the\n",
        "two features: for an average occupancy greater than two, the house price is\n",
        "nearly independent of the house age, whereas for values less than two there\n",
        "is a strong dependence on age.\n",
        "\n",
        "On a third figure, we have plotted the same partial dependence plot, this time\n",
        "in 3 dimensions.\n",
        "\n",
        ".. [1] T. Hastie, R. Tibshirani and J. Friedman,\n",
        "    \"Elements of Statistical Learning Ed. 2\", Springer, 2009.\n",
        "\n",
        ".. [2] For classification you can think of it as the regression score before\n",
        "       the link function.\n",
        "\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {},
      "outputs": [],
      "source": [
        "#Aqui vamos ler uma arquivo de Excel para começarmos a tratar os dados e as variáveis\n",
        "data = pd.read_excel(r\"D:\\OCEAN\\Dataset\\Rubelmar\\treinamento_cordoes.xlsx\" , index_col = 0)\n",
        "X = data[['v.1','u.1', 'u', 'v', 'energia_total', 't_arco']]\n",
        "y = data[['v.1','u.1']]\n",
        "from sklearn.model_selection import train_test_split\n",
        "X_train, X_test, y_train, y_test = train_test_split(X, y, random_state=1)\n",
        "print(X_train.shape)\n",
        "print(y_train.shape)\n",
        "print(X_test.shape)\n",
        "print(y_test.shape)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "collapsed": false
      },
      "outputs": [],
      "source": [
        "print(__doc__)\n",
        "\n",
        "import numpy as np\n",
        "import matplotlib.pyplot as plt\n",
        "from mpl_toolkits.mplot3d import Axes3D\n",
        "\n",
        "from sklearn.inspection import partial_dependence\n",
        "from sklearn.inspection import plot_partial_dependence\n",
        "from sklearn.ensemble import GradientBoostingRegressor\n",
        "from sklearn.neural_network import MLPRegressor\n",
        "from sklearn.datasets import fetch_california_housing\n",
        "\n",
        "\n",
        "\n",
        "def main():\n",
        "    cal_housing = fetch_california_housing()\n",
        "\n",
        "    X, y = cal_housing.data, cal_housing.target\n",
        "    names = cal_housing.feature_names\n",
        "\n",
        "    # Center target to avoid gradient boosting init bias: gradient boosting\n",
        "    # with the 'recursion' method does not account for the initial estimator\n",
        "    # (here the average target, by default)\n",
        "    y -= y.mean()\n",
        "\n",
        "    print(\"Training MLPRegressor...\")\n",
        "    est = MLPRegressor(activation='logistic')\n",
        "    est.fit(X, y)\n",
        "    print('Computing partial dependence plots...')\n",
        "    # We don't compute the 2-way PDP (5, 1) here, because it is a lot slower\n",
        "    # with the brute method.\n",
        "    features = [0, 5, 1, 2]\n",
        "    plot_partial_dependence(est, X, features, feature_names=names,\n",
        "                            n_jobs=3, grid_resolution=50)\n",
        "    fig = plt.gcf()\n",
        "    fig.suptitle('Partial dependence of house value on non-location features\\n'\n",
        "                 'for the California housing dataset, with MLPRegressor')\n",
        "    plt.subplots_adjust(top=0.9)  # tight_layout causes overlap with suptitle\n",
        "\n",
        "    print(\"Training GradientBoostingRegressor...\")\n",
        "    est = GradientBoostingRegressor(n_estimators=100, max_depth=4,\n",
        "                                    learning_rate=0.1, loss='huber',\n",
        "                                    random_state=1)\n",
        "    est.fit(X, y)\n",
        "    print('Computing partial dependence plots...')\n",
        "    features = [0, 5, 1, 2, (5, 1)]\n",
        "    plot_partial_dependence(est, X, features, feature_names=names,\n",
        "                            n_jobs=3, grid_resolution=50)\n",
        "    fig = plt.gcf()\n",
        "    fig.suptitle('Partial dependence of house value on non-location features\\n'\n",
        "                 'for the California housing dataset, with Gradient Boosting')\n",
        "    plt.subplots_adjust(top=0.9)\n",
        "\n",
        "    print('Custom 3d plot via ``partial_dependence``')\n",
        "    fig = plt.figure()\n",
        "\n",
        "    target_feature = (1, 5)\n",
        "    pdp, axes = partial_dependence(est, X, target_feature,\n",
        "                                   grid_resolution=50)\n",
        "    XX, YY = np.meshgrid(axes[0], axes[1])\n",
        "    Z = pdp[0].T\n",
        "    ax = Axes3D(fig)\n",
        "    surf = ax.plot_surface(XX, YY, Z, rstride=1, cstride=1,\n",
        "                           cmap=plt.cm.BuPu, edgecolor='k')\n",
        "    ax.set_xlabel(names[target_feature[0]])\n",
        "    ax.set_ylabel(names[target_feature[1]])\n",
        "    ax.set_zlabel('Partial dependence')\n",
        "    #  pretty init view\n",
        "    ax.view_init(elev=22, azim=122)\n",
        "    plt.colorbar(surf)\n",
        "    plt.suptitle('Partial dependence of house value on median\\n'\n",
        "                 'age and average occupancy, with Gradient Boosting')\n",
        "    plt.subplots_adjust(top=0.9)\n",
        "\n",
        "    plt.show()\n",
        "\n",
        "\n",
        "# Needed on Windows because plot_partial_dependence uses multiprocessing\n",
        "if __name__ == '__main__':\n",
        "    main()"
      ]
    }
  ],
  "metadata": {
    "kernelspec": {
      "display_name": "Python 3",
      "language": "python",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.9.11"
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}