keras搬砖系列-序贯模型简单例子
最近实验室又开始搬位子,,,有点小烦,搬来搬去并不能加快学习啊。利用好手里这批人才是关键,为什么大家心理不想想自己熟不熟悉这个领域就开始搞。。。可能最近要做语音识别了。
softmax分类器
# -*- coding: utf-8 -*-
"""
Created on Mon Jan 15 01:14:26 2018
@author: Administrator
"""
import keras
from keras.models import Sequential
from keras.layers import Dense,Dropout,Activation
from keras.optimizers import SGD
## Generate dummy data
import numpy as np
X_train = np.random.random((1000,20))
Y_train = keras.utils.to_categorical(np.random.randint(10,size=(1000,1)),num_classes=10)
X_test = np.random.random((100,20))
Y_test = keras.utils.to_categorical(np.random.randint(10,size=(100,1)),num_classes=10)
## Build a model
model = Sequential()
model.add(Dense(64,activation='relu',input_dim=20))
model.add(Dropout(0.5))
model.add(Dense(64,activation='relu'))
model.add(Dropout(0.5))
model.add(Dense(10,activation='softmax'))
sgd = SGD(lr=0.01,decay=1e-6,momentum=0.9,nesterov=True)
model.compile(loss='categorical_crossentropy',optimizer=sgd,metrics=['accuracy'])
model.fit(X_train,Y_train,epochs=20,batch_size=128)
score = model.evaluate(X_test,Y_test,batch_size=128)
这是一个简单的回归例子,产生数据大致形式是这样的。X_train建立了一个[1000,20]的矩阵,所以维数位20维。数字范围为[0-1],Y_train是标签集,有10维,每一维有1000个样本,数值全部为0,1.
模型大概是一个全连接层,然后是全连接层,然后再加一个softmax激活函数进行分类。很简单,大家可以用model.summary来进行打印模型的参数。
MLP的二分类
# -*- coding: utf-8 -*-
"""
Created on Mon Jan 15 01:14:26 2018
@author: Administrator
"""
import numpy as np
from keras.models import Sequential
from keras.layers import Dense,Dropout
X_train = np.random.random((1000,20))
Y_train = np.random.randint(2,size=(1000,1))
X_test = np.random.random((100,20))
Y_test = np.random.randint(2,size=(100,1))
model = Sequential()
model.add(Dense(64,input_dim=20,activation='relu'))
model.add(Dropout(0.5))
model.add(Dense(64,activation='relu'))
model.add(Dropout(0.5))
model.add(Dense(64,activation='relu'))
model.add(Dropout(0.5))
model.add(Dense(64,activation='relu'))
model.add(Dropout(0.7))
model.add(Dense(1,activation='sigmoid'))
model.compile(loss='binary_crossentropy',optimizer='rmsprop',metrics=['accuracy'])
model.fit(X_train,Y_train,epochs=20,batch_size=128)
score = model.evaluate(X_test,Y_test,batch_size=128)
print(score)
产生X_train的大小为1000*20,Y_train为1维的1000*1的数据。很简单的几层进行01分类。
使用LSTM
from keras.models import Sequential
from keras.layers import Dense,Dropout
from keras.layers import Embedding
from keras.layers import LSTM
model=Sequential()
model.add(Embedding(max_features,output_dim=256))
model.add(LSTM(128))
model.add(Dropout(0.5))
model.add(Dense(1,activation='sigmoid'))
model.compile(loss='binary_crossentropy',optimizer='rmsprop',
metrics=['accuracy'])
model.fit(X_train,Y_train,batch_size=16,epochs=10)
score = model.evaluate(X_test,Y_test,batch_size=16)