going through the TensorFlow with neural networks, and I tried to build a linear model with house price data set from Kaggle, where I took two inputs and assigned the sales price as the target variable. when I tried training the model with 100 iterations with the learning rate 0.02 initially, it gave me iterative values for the first 10 instances and started giving me infinity values and then Nan. I even tried tweaking the learning rate and the iteration value to 10 but still, I got a non-linear graph for the model which is unlikely. Start your code hereimport pandas as pd import numpy as npimport matplotlib.pyplot as plttrain=pd.read_csv('C:/Users/HP/Downloads/train.csv')inputs=train[['LotArea','LotFrontage']]inputs=inputs.interpolate(method='linear',limit_direction='forward')inputn=inputs.to_numpy()inputn.shapetarget=train['SalePrice']targetn=train['SalePrice'].to_numpy()targetn=targetn.reshape((1460,1))targetn.shapeobservations=len(targetn)print(observations)init_range=0.1weights=np.random.uniform(-init_range,init_range,size=(2,1))bias=np.random.uniform(-init_range,init_range,size=1)print(weights,bias)learning_rate=0.02for i in range(10): outputs=np.dot(inputn,weights)+bias deltas=outputs-targetn loss=np.sum(deltas ** 2)/2/observations print(loss) deltas_scaled=deltas/observations weights=weights- learning_rate*np.dot(inputn.T,deltas_scaled) bias=bias-learning_rate*np.sum(deltas_scaled)print(weights,bias)plt.plot(outputs,target)plt.xlabel('Output')plt.ylabel('Target')plt.show()Link for the dataset used:https://www.kaggle.com/c/house-prices-advanced-regression-techniques/data?select=train.csv

Hi there, The reason for that is that your loss function is not converging to 0, but rather - diverging to infinity. This usually happens when the learning rate you have chosen is too big. Please try with some lower number, e.g. 0.0001. Best, The 365 Team

back

Follow this topic

Tanvi Rath

Last answered:

May 21, 2020

Posted on:

May 12, 2020

When performing the linear model with l2 norm loss and gradient decent loss function reaches infinity and then nan

1 answers ( 0 marked as helpful)

365 Team

Posted on:

May 21, 2020

Submit an answer

Content