The VG Resource › The Resources › The Spriters Resource › Ripping Help v
I need a download manager with the following specifications


Users browsing this thread: 2 Guest(s)
I need a download manager with the following specifications
TeridaxXD001 Offline
Member
*
Posts: 246
Threads: 75
Joined: Feb 2014
#1
01-16-2017, 11:12 PM (This post was last modified: 01-16-2017, 11:14 PM by TeridaxXD001.)
As some of you may have noticed, I have been ripping cards from THE iDOLM@STER: Cinderella Girls since around September. The cards come in various sizes (extra small/icon, small, medium and large) and other styles (no frame, signed in black, signed in color and quest). This is a tedious time-consuming process involving copying and pasting filenames (which are long, random strings of characters) into URLs for the directories of each size/style, and then manually dragging and dropping them into the folders on my hard drive.

I'm looking for this to help save time: a download manager that will allow me to import a list of URLs, download them in the order they appear on the list, and rename them in a way that will make them easy to keep this order in Windows Explorer, for example: 001 [filename].jpg, 002 [filename].jpg, etc.

I tried DownThemAll, a Firefox plugin, but it numbers them all according to the number of download sessions I've done. So if it's my 50th download session, it numbers them all 50. Not helpful in the least.
Reply
Thanked by:
puggsoy Offline
I'm warning you, I'm unstable!
***
Retired Staff
Posts: 5,501
Threads: 134
Joined: Dec 2011
Resource - Sounds Resource - Sprites Resource - Textures Steam YouTube (/name)
Silver Halloween Attack BadgeHalloween Helper BadgeIcon Badge
#2
01-16-2017, 11:36 PM
I can probably whip something up when I'm home. Can you give me sample names and such to test with?
You may have a fresh start any moment you choose, for this thing that we call "failure" is not the falling down, but the staying down. -Mary Pickford
Website
Reply
Thanked by:
TeridaxXD001 Offline
Member
*
Posts: 246
Threads: 75
Joined: Feb 2014
#3
01-16-2017, 11:47 PM (This post was last modified: 01-16-2017, 11:58 PM by TeridaxXD001.)
(01-16-2017, 11:36 PM)puggsoy Wrote: I can probably whip something up when I'm home. Can you give me sample names and such to test with?

Yeah. Online directories:

http://125.6.169.35/idolmaster/image_sp/card/xs/[filename]

http://125.6.169.35/idolmaster/image_sp/card/s/[filename]

http://125.6.169.35/idolmaster/image_sp/card/m/[filename]

http://125.6.169.35/idolmaster/image_sp/card/l/[filename]

http://125.6.169.35/idolmaster/image_sp/card/l_noframe/[filename]

http://125.6.169.35/idolmaster/image_sp/card_sign_b/l/[filename]

http://125.6.169.35/idolmaster/image_sp/card_sign_p/l/[filename]

http://125.6.169.35/idolmaster/image_sp/card/ls/[filename]


Example files:

1515860fd22175a20c99d8007cf8faae.jpg
120b0acaa2c1419c3de79c1e6ef6890a.jpg
212bb3e0d7f2ba5bcdeced90bf48561b.jpg
c8e7deaf2263a700b6f7d41902770f41.jpg
9a21c3eaede2b44ea3fbeb6c46f631f5.jpg
01501d1215a4b5d6a9260a2a13acd4cf.jpg
Reply
Thanked by:
puggsoy Offline
I'm warning you, I'm unstable!
***
Retired Staff
Posts: 5,501
Threads: 134
Joined: Dec 2011
Resource - Sounds Resource - Sprites Resource - Textures Steam YouTube (/name)
Silver Halloween Attack BadgeHalloween Helper BadgeIcon Badge
#4
01-17-2017, 09:01 AM
OK, here you go. Pretty easy to use, first you make a text file that has the address to the directory on the first line, and the names of the files on all the following lines. So for example something like this:

Code:
http://125.6.169.35/idolmaster/image_sp/card/xs/

1515860fd22175a20c99d8007cf8faae.jpg
120b0acaa2c1419c3de79c1e6ef6890a.jpg
212bb3e0d7f2ba5bcdeced90bf48561b.jpg
c8e7deaf2263a700b6f7d41902770f41.jpg
9a21c3eaede2b44ea3fbeb6c46f631f5.jpg
01501d1215a4b5d6a9260a2a13acd4cf.jpg

(Empty lines are just ignored.)

Run the program via the command-prompt, passing this text file as the first argument and the name for an output directory as the second:

Code:
idolDownloader list.txt xsOut

Wait a while, and it'll say when it's done. The files will be downloaded into the specified directory with a number at the front of the filename, depending on the order in the text file.

By the way, I made this with a programming language that's relatively new to me, so be sure to say if you notice any weird stuff. Hopefully it should all go smoothly though!
You may have a fresh start any moment you choose, for this thing that we call "failure" is not the falling down, but the staying down. -Mary Pickford
Website
Reply
Thanked by: volo, TeridaxXD001
TeridaxXD001 Offline
Member
*
Posts: 246
Threads: 75
Joined: Feb 2014
#5
01-17-2017, 05:32 PM
Thank you! This seems to work great. To tell the truth, I was just seeing if anyone knew of an existing download manager that could do this, but it's better to have a program that is specifically meant for this kind of thing. I've already added some sheets made from sprites obtained through it.
Reply
Thanked by: puggsoy
TeridaxXD001 Offline
Member
*
Posts: 246
Threads: 75
Joined: Feb 2014
#6
03-04-2017, 07:34 PM
I ran into something. Would it be possible to update this so it will download the same files from different directories? Like:

Code:
http://125.6.169.35/idolmaster/image_sp/card_sign_b/l/
http://125.6.169.35/idolmaster/image_sp/card_sign_b/m/
http://125.6.169.35/idolmaster/image_sp/card_sign_b/s/

5f86b28cd88a283adc8408184d57da8d.jpg
14e6c94e4cc163ffedd84a8ebba62e90.jpg

And then get each file from each directory in them given order of the directories? Like:

001_5f86b28cd88a283adc8408184d57da8d.jpg (first directory)
002_14e6c94e4cc163ffedd84a8ebba62e90.jpg (first directory)
003_5f86b28cd88a283adc8408184d57da8d.jpg (second directory)
004_14e6c94e4cc163ffedd84a8ebba62e90.jpg (second directory)
005_5f86b28cd88a283adc8408184d57da8d.jpg (third directory)
006_14e6c94e4cc163ffedd84a8ebba62e90.jpg (third directory)
Reply
Thanked by:
puggsoy Offline
I'm warning you, I'm unstable!
***
Retired Staff
Posts: 5,501
Threads: 134
Joined: Dec 2011
Resource - Sounds Resource - Sprites Resource - Textures Steam YouTube (/name)
Silver Halloween Attack BadgeHalloween Helper BadgeIcon Badge
#7
03-05-2017, 02:42 AM
I think I might be starting to get the hang of functional programming Smile

Same download link, run it the same way. The only difference is that the first line in your file now needs to be the number of directories. So for your example you'd write this:

Code:
3
http://125.6.169.35/idolmaster/image_sp/card_sign_b/l/
http://125.6.169.35/idolmaster/image_sp/card_sign_b/m/
http://125.6.169.35/idolmaster/image_sp/card_sign_b/s/

5f86b28cd88a283adc8408184d57da8d.jpg
14e6c94e4cc163ffedd84a8ebba62e90.jpg

If you want to use it for just a single directory like before, just write 1.
You may have a fresh start any moment you choose, for this thing that we call "failure" is not the falling down, but the staying down. -Mary Pickford
Website
Reply
Thanked by: TeridaxXD001
TeridaxXD001 Offline
Member
*
Posts: 246
Threads: 75
Joined: Feb 2014
#8
03-05-2017, 03:46 AM
Thank you, this is working well.

And let me know if you've made any progress on those Nancy Drew files.
Reply
Thanked by: puggsoy
TeridaxXD001 Offline
Member
*
Posts: 246
Threads: 75
Joined: Feb 2014
#9
11-14-2017, 10:53 PM
Hey puggsoy, would it be possible to change it so the variations of each files are grouped together? Like:


Code:
8
http://125.6.169.35/idolmaster/image_sp/card_sign_b/s/
http://125.6.169.35/idolmaster/image_sp/card_sign_b/m/
http://125.6.169.35/idolmaster/image_sp/card_sign_b/m2/
http://125.6.169.35/idolmaster/image_sp/card_sign_b/l/
http://125.6.169.35/idolmaster/image_sp/card_sign_p/s/
http://125.6.169.35/idolmaster/image_sp/card_sign_p/m/
http://125.6.169.35/idolmaster/image_sp/card_sign_p/m2/
http://125.6.169.35/idolmaster/image_sp/card_sign_p/l/

40a601df9bea01621e36d1ab686f16e3.jpg
58135fa927f8d12eaa6228dc0bdf62e9.jpg

And you'd get:
(card_sign_b/s)001_40a601df9bea01621e36d1ab686f16e3.jpg
(card_sign_b/m)002_40a601df9bea01621e36d1ab686f16e3.jpg
(card_sign_b/m2)003_40a601df9bea01621e36d1ab686f16e3.jpg
(card_sign_b/l)004_40a601df9bea01621e36d1ab686f16e3.jpg
(card_sign_p/s)005_40a601df9bea01621e36d1ab686f16e3.jpg
(card_sign_p/m)006_40a601df9bea01621e36d1ab686f16e3.jpg
(card_sign_p/m2)007_40a601df9bea01621e36d1ab686f16e3.jpg
(card_sign_p/l)008_40a601df9bea01621e36d1ab686f16e3.jpg
(card_sign_b/s)009_58135fa927f8d12eaa6228dc0bdf62e9.jpg
(card_sign_b/m)010_58135fa927f8d12eaa6228dc0bdf62e9.jpg
(card_sign_b/m2)011_58135fa927f8d12eaa6228dc0bdf62e9.jpg
(card_sign_b/l)012_58135fa927f8d12eaa6228dc0bdf62e9.jpg
(card_sign_p/s)013_58135fa927f8d12eaa6228dc0bdf62e9.jpg
(card_sign_p/m)014_58135fa927f8d12eaa6228dc0bdf62e9.jpg
(card_sign_p/m2)015_58135fa927f8d12eaa6228dc0bdf62e9.jpg
(card_sign_p/l)016_58135fa927f8d12eaa6228dc0bdf62e9.jpg

..and so on?
Reply
Thanked by:


Forum Jump: