Welcome to the Lockn' Forum - The home of the original Lockn' Music Festival family!
Please note: This forum is in no way officially associated with Lockn' Festival or its promoters.
Post by southernman on Jun 25, 2017 14:35:28 GMT -5
Question in title. Trying to work on a project
thelizard
Old Head
This is so much FUN!!
Posts: 1,796
If I could add one artist to the 2023 lineup: Neil Young
Number of LOCKNs attended: 7
Anybody know how to write/program a web scraper?
Jun 25, 2017 17:25:36 GMT -5
The Other One likes this
Post by thelizard on Jun 25, 2017 17:25:36 GMT -5
It depends. They usually don't work anymore due to things like javascript and JQuery which dynamically update web page content after the page GET. Meaning the DOM is not static and can't really be scrapped.
You can accomplish something similar by either checking for REST interfaces on the site and grabbing the content that way. Or, you can use a crawler to grab a cache/index of the site, and then grep/parse the cache to find the specific content you want.
Why do you ask?
I'm not signing this!
mccjeff
Merry Prankster
Look, a squirrel!
Posts: 7,848
If I could add one artist to the 2023 lineup: BIG Something
Anybody know how to write/program a web scraper?
Jun 26, 2017 10:36:52 GMT -5
The Other One likes this
Post by mccjeff on Jun 26, 2017 10:36:52 GMT -5
That is what I was going to say.It depends. They usually don't work anymore due to things like javascript and JQuery which dynamically update web page content after the page GET. Meaning the DOM is not static and can't really be scrapped.
You can accomplish something similar by either checking for REST interfaces on the site and grabbing the content that way. Or, you can use a crawler to grab a cache/index of the site, and then grep/parse the cache to find the specific content you want.
Why do you ask?
This is your last chance. After this, there is no turning back. You take the blue pill—the story ends, you wake up in your bed and believe whatever you want to believe. You take the red pill—you stay in Wonderland, and I show you how deep the rabbit hole goes. Remember: all I'm offering is the truth. Nothing more.
What happens if I take both?
Post by southernman on Jun 26, 2017 15:13:40 GMT -5
I was wondering if it would be possible to scrape setlists off of the archive and dump them into a database.
I am probably over my head. Most of what you wrote didn't make sense to me. It just might be more manageable than imputting them all individually...
The Other One
Cowboy Neal
Posts: 12,098
If I could add one artist to the 2023 lineup: Dead and Company featuring Johnny Slayer
Number of LOCKNs attended: 7
Anybody know how to write/program a web scraper?
Jun 26, 2017 15:23:24 GMT -5
smosey wales likes this
Post by The Other One on Jun 26, 2017 15:23:24 GMT -5
Hasn't that been done? www.setlists.net/I was wondering if it would be possible to scrape setlists off of the archive and dump them into a database. 
I am probably over my head. Most of what you wrote didn't make sense to me. It just might be more manageable than imputting them all individually...
I'm sure that you have all of the Yarn setlists memorized so you wouldn't need those...
Every day is just a new chance to stumble. - BMFS
Buy the ticket, take the ride...
the KIND 1/26
Dead Reckoning 1/27
Daniel Donato 2/3
St. Patty's Day Party 3/16
Del McCoury BAnd 4/25
About Time Music Festival 5/3-4
Rooster Walk 5/23-26
Floydfest 7/24-28
Yarnival 10/24-26
The Other One
Cowboy Neal
Posts: 12,098
If I could add one artist to the 2023 lineup: Dead and Company featuring Johnny Slayer
Number of LOCKNs attended: 7
Anybody know how to write/program a web scraper?
Jun 26, 2017 15:25:33 GMT -5
mccjeff, thelizard, and 1 more like this
Post by The Other One on Jun 26, 2017 15:25:33 GMT -5
When you say that^^^ I hear this...It depends. They usually don't work anymore due to things like javascript and JQuery which dynamically update web page content after the page GET. Meaning the DOM is not static and can't really be scrapped.
You can accomplish something similar by either checking for REST interfaces on the site and grabbing the content that way. Or, you can use a crawler to grab a cache/index of the site, and then grep/parse the cache to find the specific content you want.
Why do you ask?
Every day is just a new chance to stumble. - BMFS
Buy the ticket, take the ride...
the KIND 1/26
Dead Reckoning 1/27
Daniel Donato 2/3
St. Patty's Day Party 3/16
Del McCoury BAnd 4/25
About Time Music Festival 5/3-4
Rooster Walk 5/23-26
Floydfest 7/24-28
Yarnival 10/24-26
Deleted
Deleted Member
Posts: 0
Post by Deleted on Jun 27, 2017 12:19:14 GMT -5
Pretty sure my old Cutlass was powered by one of these turbo encabulator type transmissions. Except my magneto deflabulater was made of chelated unobtanium oxide.When you say that^^^ I hear this...
