UPDATE: Is even the API too "Slow"? Many Loans are Gone Before Caught by the API

[viking]

One of the most popular sites that is using an API to capture Lending Club's loans is Interest Radar (IR). However, it appears that many loans are already gone by the time IR is able to display them on their website.

Here is an example of the number of available E-G loans on LC's (blue) and IR's (red) websites as they were released on 8/26/13 at 2 PM (each data point is spaced 4-5 sec apart):
https://forum.lendacademy.com/proxy.php?request=http%3A%2F%2Fwww.lendacademy.com%2Fforum%2Findex.php%3Faction%3Ddlattach%3Btopic%3D1507.0%3Battach%3D343&hash=39033a32808c9427c356f59024a0e38d" alt="" class="bbc_img" />

Only about half the the number of LC's loans were available on IR when they were first posted.
The graph also shows that there were several "new" loans released throughout the 14 min period after the initial spike (possibly from loans released from holds in the shopping carts). Many of these loans were not detected by IR because the available loans are only captured at intervals.

I am guessing (but I don't know), that the Auto-buy on IR would use loans from the same pool as shown on IR's website and many LC loans may therefore not be purchased. Furthermore, I believe that the Auto-buy is only executed once, so the "new" loans may not be purchased? Rev??

It would be interesting to know if the other Auto-buy sites are also lagging LC's website (I would presume that they do!)?  I suspect that LC is releasing the loans on their website before the data is even available to the API? Is that possible...?


UPDATED 9/18/13. Because of a post by Rev today (http://www.lendacademy.com/forum/index.php?topic=1583.msg12564#msg12564" class="bbc_link" target="_blank">http://www.lendacademy.com/forum/index.php?topic=1583.msg12564#msg12564), I compared the number of available loans on LC and IR again (9/18/13 at 2 PM); IR's posting time is now much improved! Thanks, Rev!
https://forum.lendacademy.com/proxy.php?request=http%3A%2F%2Fwww.lendacademy.com%2Fforum%2Findex.php%3Faction%3Ddlattach%3Btopic%3D1507.0%3Battach%3D362&hash=010d3a122ed22478c7d7643fb03b2534" alt="" class="bbc_img" />


[attachment deleted by admin]

[jpildis]

Great analysis... I've seen the same thing and it's very troubling.  I would love to see a comparison between the available auto-invest tools that are currently available.  Anyone else up for a bake-off?

[core]

https://forum.lendacademy.com/index.php?topic=1507.msg11615#msg88888888Quote"> from: jpildis on August 30, 2013, 08:46:30 AM

[LC Adv]

If you want more speed locate your server in Santa Monica. You can probably cut your ping time in 1/2 although a microsecond is all you really need

[brycemason]

Experimenting with various methods of auto buying for my own site has proven quite the learning experience. I totally get this chart.

[TravelingPennies]

https://forum.lendacademy.com/index.php?topic=1507.msg11618#msg88888888Quote"> from: LC Adv on August 30, 2013, 09:30:45 AM

[Fred]

https://forum.lendacademy.com/index.php?topic=1507.msg11611#msg88888888Quote"> from: viking on August 30, 2013, 06:20:42 AM

[TonySaunders]

Interest Radar has to somehow attempt to buy notes for ALL of their many clients during the 2-3 seconds that the best notes are available. I don't see how they can possibly succeed, and my experience with IR tells me that they are not succeeding at securing the best notes.

It's worth noting that the more capable the API, the worse this problem is. There's not enough of the best notes for everyone to have as much as they want and faster automation just means you get left out faster.

[TravelingPennies]

https://forum.lendacademy.com/index.php?topic=1507.msg11637#msg88888888Quote"> from: TonySaunders on August 30, 2013, 04:43:51 PM

[TravelingPennies]

https://forum.lendacademy.com/index.php?topic=1507.msg11637#msg88888888Quote"> from: TonySaunders on August 30, 2013, 04:43:51 PM

[TravelingPennies]

https://forum.lendacademy.com/index.php?topic=1507.msg11641#msg88888888Quote"> from: core on August 30, 2013, 04:55:38 PM

[Rob L]

Mini nuclear arms race for LC notes

[TravelingPennies]

https://forum.lendacademy.com/index.php?topic=1507.msg11641#msg88888888Quote"> from: core on August 30, 2013, 04:55:38 PM

[TravelingPennies]

https://forum.lendacademy.com/index.php?topic=1507.msg11644#msg88888888Quote"> from: Rob L on August 30, 2013, 05:17:41 PM

[AmCap]

I don't want to weigh in too heavily here, but if I can just make the larger point that folks forget that all of the LC universe seems focused on the very smallest fraction of LC notes that are available.  I see that in 2013, there have been 66,027 loans that LC has issued: assuming by "good notes" people mean E-G 400+, the number issued is 1,302.  Less than 2%.  Filters more restrictive than IR01 alone will yield even less. 

I really think we all should take Peter's post to heart and re-evaluate our expectations.  Unless users of other auto-invest services would like to weigh in, I think it's pretty unreasonable to target the same 2% of notes everybody else wants and be surprised to be shut out of them.  We may need to open some filters up...look at higher rated notes.  Maybe a B note won't kill us (that is, you'll still get better yield than a lot of debt instruments available).  Expanding the "good note" universe to C and D notes expands the number of issued notes by a factor of 10.