weixin_28903789的博客

原创 数据分析师学习路线规划路径（详细到只需要无脑执行）

原创 正则表达式笔记

1.正则表达式的使用场景无外乎两种：一种是查找特定的信息（搜索），另一种是查找并编辑特定的信息（替换）。2.1 匹配单个字符

原创 python回归预测，从变量加工到建模预测（分子模型）RF,LGB,SVR,DNN实现

import numpy as npimport pandas as pd# import pyreadstatimport timeimport datetime as dtfrom sklearn.model_selection import GridSearchCVfrom sklearn.model_selection import cross_val_scoreimport matplotlib.pyplot as pltfrom scipy import statsimport

原创 python画箱线图(显示离群值的标签)

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltimport matplotlib as mplmpl.rcParams['font.sans-serif'] = ['simHei']mpl.rcParams['axes.unicode_minus'] = Falsepath = 'E:/data/'df_plot = pd.read_excel(path+'factor3.xlsx')col = '

原创 python进行主成分、因子分析

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltimport matplotlib as mpl#画图中的显示中文mpl.rcParams['font.sans-serif'] = ['simHei']mpl.rcParams['axes.unicode_minus'] = Falsefrom factor_analyzer import FactorAnalyzerpath = 'E:/data/'

原创 python连接postgre数据库进行读取数据、增删改操作、处理好数据入库

1.读取数据、操作数据库、数据入库的功能函数import psycopg2import psycopg2.extras#1.读取数据def queryGp(sql): ## 连接到一个给定的数据库 conn = psycopg2.connect(dbname="xxxx", user="xxxx", password="xxxx!", port="xxxx", host="xxxx") df = pd.read_sql(s

原创 python实现RFM模型分析

python实现RFM模型分析import numpy as npimport pandas as pdimport pyreadstatimport matplotlib.pyplot as pltfrom mpl_toolkits.mplot3d import Axes3D # 空间三维画图import timeimport datetime as dt#========...

原创 机器学习小技巧，各算法建模代码

一、机器学习常用技巧1.自动编码方法: 第一种是pd.Categorical().Codes 第二种是用:LableEncoder非常智能，会按照原数据的某种顺序关系来编码 sklearn：先from sklearn.preprocessing import LableEncoder LableEncoder().fit_transform(dat...

原创 机器学习算法汇总梳理

1 逻辑回归(LR)：将线性回归的结果通过sigmoid函数映射到了(0,1)区间，可以当做是正例的概率，从而实现分类。不能实现回归。2 决策树(DT)：决策树是一种递归的选择最优特征，然后根据最优特征分割数据集，使得各个子集都有一个最好的分类。回归则是通过最小二乘法来实现。不同的算法有不同的分类依据：算法ID3C4.5CART分类依据信息增益信息增益率基尼...

原创 apply-score-card-from-lending-club

# This Python 3 environment comes with many helpful analytics libraries installed# It is defined by the kaggle/python docker image: https://github.com/kaggle/docker-python# For example, here's sever...

原创 题目一、建模过程代码

import numpy as npimport pandas as pdimport matplotlib as mplimport matplotlib.pyplot as pltfrom sklearn.preprocessing import LabelEncoder, StandardScalerfrom sklearn.impute import SimpleImputer...

原创 题目二、代码

import jsonimport pandas as pdpath = 'F:/data/'tabel3 = pd.read_excel(path+'表3.xlsx')#建立新的dataframetabel3d = pd.DataFrame()for i in range(tabel3.shape[0]): a = tabel3['report'].values[i]...

原创 Titanic

import reimport numpy as npimport pandas as pdimport matplotlib.pyplot as pltimport seaborn as snsimport warningswarnings.filterwarnings('ignore')%matplotlib inline一、数据总览#1.数据总览path = 'E:...

原创 数据处理

import numpy as npimport pandas as pdimport matplotlib as mplimport matplotlib.pyplot as pltimport seaborn as snspath = 'G:\\data\\'data = pd.read_excel(path+'数据分析岗位笔试题_2019.xlsx')data.head()...