CEAC data is available and we are scraping!!!

Discussion in 'Lottery Visas - DV' started by Britsimon, Jan 1, 2018.

  1. Aaron Runnalls

    Aaron Runnalls New Member

    Can someone explain to me how solving captcha's gives us this information?? I spent some time yesterday doing them, just would like to know how it is helping the cause.
    Also, another question; my wife is watching and reading all she can on the diversity lottery. We've perused tons and tons of data. One that we came across was the number of selectees for SA at a hair under 5000. But from the 'data scrape' so far, it shows a max case number of 2600'ish. How can this be the case?
    We're in the low SA21**, and let me tell you, living in our part of canaduh sucks the big one. The land of taxes, I so want to sign up as a refugee if we don't get through this year ;)
     
    Last edited: Jan 18, 2018
  2. Pierre82

    Pierre82 Well-Known Member

    What part of SA are you originally from? Congrats on your selection and keep a close eye on the VB because your case number is little high compared to previous years.
     
  3. Aaron Runnalls

    Aaron Runnalls New Member

    Wife is from Grenada, only 11 selected from there. We live in Canada though, we're watching closely hoping the travel ban aids us some.
    If it's as mentioned earlier, maybe the rush to get Venezuelans through in numbers will be a part of us getting through.
     
    Last edited: Jan 18, 2018
  4. Pierre82

    Pierre82 Well-Known Member

    Congrats to both of you and hope your case number gets an interview.
     
  5. Aaron Runnalls

    Aaron Runnalls New Member

    Thanks, much appreciated.
     
  6. Britsimon

    Britsimon Super Moderator

    Each captcha solved allows the program to capture the details of a case number in CEAC. THat data gives valuable insights.

    Each case includes derivatives, at about 2 people for each case. So - 4995 people (including derivatives) is less cases.
     
  7. Aaron Runnalls

    Aaron Runnalls New Member

    So when the number 11 is shown for the country, Grenada in our example, does that mean there are 11 cases, or is this 11 including derivatives?
     
  8. Xarthisius

    Xarthisius Active Member

    That is a count of people (selectees + their families). In an extreme case, that could mean that e.g. only 2 people were actually selected from Grenada: your wife and someone with a spouse and 7 children. There's no way to get the number of cases per country from CEAC data as it's not provided there.

    However, US Department of State provides some statistics regarding visas issued per country of chargeability. Unfortunately, it takes some time for DoS to gather the data. They release it with a 2 month delay. AFAICT nobody from Grenada received a GC in October and November 2017.
     
  9. Aaron Runnalls

    Aaron Runnalls New Member

    Good chance it is 2 then, we have 2 kids, the 3rd was born in the US, so doesn't have to go through this with us. I just don't want to wait till he's old enough to sponsor us, I'll be too old by then ;)
    Just how much scraping is there to do? I think I'm close to 500, there are lots of people with nearly 9000 scrapes...
     
  10. Xarthisius

    Xarthisius Active Member

    It's an ongoing effort, we will be doing that as long as there are people willing to do that and DV is still going. Once we get a status for a case and it's e.g. 'Ready' after few days we revisit it to see if something happened with it. Some cases (holes, visas that were issued or refused) are scanned only once.
     
  11. Aaron Runnalls

    Aaron Runnalls New Member

    How often is this data updated in the available charts Xarth? Is this the stuff I'm seeing in the data sets I've seen linked on Simon's site?
     
  12. Xarthisius

    Xarthisius Active Member

    1) Roughly every 5 days, unless something notable happens (like 2NLs being sent). I'll post a new release tomorrow.
    2) I guess so. I'm talking about the charts/data available here: https://dvcharts.xarthisius.xyz/ceacFY18.html
     
  13. Aaron Runnalls

    Aaron Runnalls New Member

    I notice on the charts that in SA from 601 to 700, there is an 87% no response rate. Is this just because it is too early?
     
  14. Xarthisius

    Xarthisius Active Member

    Yes, it's too early. Previous cutoff for SA was 625. 2NL for range 625 - 800 are being sent right now, CEAC site hasn't updated yet.
     
  15. Xarthisius

    Xarthisius Active Member

    I just released a new db dump after the initial pass over cases that received 2NLs today. I also updated charts to show cases that are "In Transit". Make sure you do a hard refresh on the page in order to clean cache from old data.
     
  16. Aaron Runnalls

    Aaron Runnalls New Member

    When Simon speaks of density as far as the data shows, exactly what is he referring to?
     
  17. Xarthisius

    Xarthisius Active Member

    I think you can find the most comprehensive answer here: http://britsimonsays.com/dv2016-analysis/
     
  18. Aaron Runnalls

    Aaron Runnalls New Member

    Thanks, that was what I was looking for.
     
  19. Xarthisius

    Xarthisius Active Member

    Since multiple people asked about that feature, that's now available online.
     
    DanE1978 likes this.
  20. Britsimon

    Britsimon Super Moderator


    Damn you're good!

    I have to say - the visualization of the data is impressive. I love the time bar. I have lost count how many times I tried to explain certain concepts that the visualization immediately makes clear.
     

Share This Page