View Post [edit]
Poster: | tracey pooh | Date: | Jul 11, 2015 8:37pm |
Forum: | forums | Subject: | Re: Library View Count Not Updating |
i'm 99.99% sure we never tracked "my favorites" views counts (and if we did, it was only for a short spell and found it presently untractable with our current system and resources.
i'm the website lead programmer and have been so at archive.org for over 10 years now, so you get a sense of where the comments are coming from 8-) -- no "telephone" or "lost in translation" issues going on from our end.
rolling up groups of items view counts has proved difficult for us (for various reasons) so we've mostly stuck to tracking "standard" collections of items (eg: /details/prelinger or /details/GratefulDead or even /details/texts etc.)
and even then, we've had a fair amount of issues over the years.
best regards,
-tracey
Reply [edit]
Poster: | geekcookiespodcast | Date: | Jul 15, 2015 2:36am |
Forum: | forums | Subject: | Re: Library View Count Not Updating |
good to know you are an expert about the infrastructure!
I'm uploading our podcast audio files to archive and I'm pretti sure the "view" columns was update every 24h until one month or so (I wrote a scraper to have download history for each element).In the search for the element I uploaded :
https://archive.org/search.php?query=uploader%3A%22geekcookiespodcast%40gmail.com%22
the view count is now stuck, but at the single element level is stil updating. It is the same if I ask for json or xml result.
Here the json output:
https://archive.org/advancedsearch.php?q=uploader%3A%22geekcookiespodcast%40gmail.com%22&fl[]=downloads&fl[]=identifier&fl[]=title&sort[]=addeddate+desc&sort[]=&sort[]=&rows=50&page=1&output=json&callback=callback&save=yes
I was excited to get the json output, no more scraping aorund!
Is there something I'm doing wrong? Is a place where I can get the aggregated views count from all the files I upload?
Thanks and thank you for the terrific work behind the scenes!
Reply [edit]
Poster: | tracey pooh | Date: | Jul 15, 2015 7:04am |
Forum: | forums | Subject: | Re: Library View Count Not Updating |
"the view count is now stuck, but at the single element level is stil updating."
because there is no aggregated view count that we compute or output/produce for an arbitrary search.
Using a JSON indenter and "colordiff" (to make it easy), I'll verify much of my items change tonight by comparing today's output with tomorrow's output of this:
https://archive.org/advancedsearch.php?q=collection%3ApoohBot&fl%5B%5D=downloads&fl%5B%5D=identifier&sort%5B%5D=identifier+asc&sort%5B%5D=&sort%5B%5D=&rows=500&page=1&output=json
Reply [edit]
Poster: | tracey pooh | Date: | Jul 16, 2015 7:35am |
Forum: | forums | Subject: | Re: Library View Count Not Updating |
I think I now understand what you are referring to, and there *IS* a new problem I was able to find just now.
So I think what you've been noticing is that individual items in our search engine (ie: not collections, but single items) have had their download counts updated nightly normally, but that stopped semi-recently.
CORRECT! 8-) (that's good and bad news, right?)
We are in process of migrating our search engine. Our current live (soon to be dropped) search engine *just* ran out of avail space in /tmp for what it needs to do each night to update items.
So I've pushed live a workaround and am manually re-running last night's run now (and then every night the normal run should be fine after that).
Sorry for the confusion trying to sort out the issue -- I appreciate you sticking with us and helping us sort out the issue.
It's embarrassing that our user base found and reported the issue before we did -- and I apologize for that.
(We have robo-checks for full disks running 24x7 -- but in this sort case, it hit 100%, fatal-ed, then disk cleaned up very quickly so we never hit a threshold trigger).
I'd make the script more bulletproof to a fail like this -- but we are replacing the Search Engine w/i the next 15-90 days...
Best regards, and thanks for putting up with our little glitches from time to time!
-Tracey
Reply [edit]
Poster: | geekcookiespodcast | Date: | Jul 16, 2015 10:14am |
Forum: | forums | Subject: | Re: Library View Count Not Updating |
thans!
It's really amazing you find time to solve this tiny issue, I can barely imagine the volume of stuff you have to work on in this website.
I'm really happy I can rely on the json now, I really didn't want to write a cumbersone parser (I'm really bad at it :-)
That is an example of what I was tracking for the first of my upload
http://www.charted.co/?{%22dataUrl%22%3A%22http%3A%2F%2Fgeekcookies.brapi.net%2Fgeekcookies_ep_0.csv%22}
Thank you and keep up the good work!
Reply [edit]
Poster: | tracey pooh | Date: | Aug 7, 2015 7:18pm |
Forum: | forums | Subject: | Re: Library View Count Not Updating |
happy weekend!
Reply [edit]
Poster: | CaseUploader155 | Date: | Sep 19, 2015 11:51am |
Forum: | forums | Subject: | Re: Library View Count Not Updating |
https://archive.org/details/USAvHill
Also those documents came from PACER so they are public record and can legally be uploaded under federal law. Just needed to note that. Also I ask that you not Judge the person named in those case files as he is trying to prove Actual Innocence to his charge. Thee documents in that upload are uploaded for the purpose of putting the truth on the public record.
Please I beg of you to fix the view count as I believe the documents are getting a lot of views due to the nature of this criminal case and the fact that the Defendant is persistent in trying to prove Actual Innocence to the crime he was indicted on. I know the views are higher then 300 but it is stuck at 300.
Reply [edit]
Poster: | geekcookiespodcast | Date: | Jul 17, 2015 4:56am |
Forum: | forums | Subject: | Re: Library View Count Not Updating |
This post was modified by geekcookiespodcast on 2015-07-17 11:56:16