Quantcast
Channel: R.NET
Viewing all articles
Browse latest Browse all 1634

New Post: How to load data efficently?

$
0
0
OK, you may have a way out of your perf trouble.

I attach the output of the profiling and improvements done so far at the page https://rdotnet.codeplex.com/workitem/56
  • Only the new faster CreateVector operations is shown. ~2 orders of magnitude faster is what observed.
  • Middle section is the comparison before/after for R to .NET array conversions. This is insanely faster: ~3 orders of magnitudes. I needed to check several times this was not a "fake" measure. Seems not. Basic numeric tests confirm it is working properly.
  • R to .NET conversion tops at 400ms for 100 million long numeric vector. Beyond that is too large to test for R by default it seems even x64.
Code is commited to a branch named workitem56. You can pull changes and have a go if you wish.
You should consider this code branch alpha, would it be just because the API will probably change after discussion with the main author: there is a new ToArrayFast method that may not be the most elegant way to override the default ToArray method extension of the .NET framework.

Cheers

Viewing all articles
Browse latest Browse all 1634

Trending Articles