Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

all elements in XTHost and ThetaTHost are all Nan #19

Open
zhenv5 opened this issue Oct 3, 2017 · 2 comments
Open

all elements in XTHost and ThetaTHost are all Nan #19

zhenv5 opened this issue Oct 3, 2017 · 2 comments

Comments

@zhenv5
Copy link

zhenv5 commented Oct 3, 2017

I ran it on ml10M dataset. And #define SURPASS_NAN is used to avoid Nan test error.

But all elements in XTHost and ThetaTHost are all NaN. Could you help me figure it out?

Thanks very much.
Best.

@wei-tan
Copy link
Member

wei-tan commented Dec 4, 2017

Could you please paste your code here?

@sh1ng
Copy link

sh1ng commented Mar 4, 2019

I'm experiencing the same problem.

make all

As my laptop only has 2 Gb of memory I had to use batches

./main 71567 65133 100 9000048 1000006 0.05 2 2 ./data/ml10M/
M = 71567, N = 65133, F = 100, NNZ = 9000048, NNZ_TEST = 1000006, lambda = 0.050000
X_BATCH = 2, THETA_BATCH = 2
DATA_DIR = ./data/ml10M/ 
*******start loading training and testing sets to host.
*******parameters: m: 71567, n:  65133, f: 100, nnz: 9000048 
*******start allocating memory on GPU...
*******start copying memory to GPU...
*******start iterations...
	CG solver with fp32.
	CG solver with fp32.
	CG solver with fp32.
	CG solver with fp32.
--------- Train RMSE in iter 0: nan
--------- Test RMSE in iter 0: nan
	CG solver with fp32.
	CG solver with fp32.
	CG solver with fp32.
	CG solver with fp32.
--------- Train RMSE in iter 1: nan
--------- Test RMSE in iter 1: nan
	CG solver with fp32.
	CG solver with fp32.
	CG solver with fp32.
	CG solver with fp32.
--------- Train RMSE in iter 2: nan
--------- Test RMSE in iter 2: nan
	CG solver with fp32.
	CG solver with fp32.
	CG solver with fp32.
	CG solver with fp32.
--------- Train RMSE in iter 3: nan
--------- Test RMSE in iter 3: nan
	CG solver with fp32.
	CG solver with fp32.
	CG solver with fp32.
	CG solver with fp32.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants