amiga.org
     
iconAll times are GMT -6. The time now is 05:07 AM. | Welcome to Forum, please register to access all of our features.

» Amiga.org » Amiga computer related discussion » Amiga Software Issues and Discussion » Bulk Newsgroup Decoding (was:UUDecode question)

Amiga Software Issues and Discussion This forum exists for the discussion of the use, issues with, and fun brought about by classic and next generation Amiga software.

Reply
 
Thread Tools Display Modes
Old 11-11-2003, 02:41 AM   #1
Madgun68
Cult Member
Points: 6,093, Level: 50 Points: 6,093, Level: 50 Points: 6,093, Level: 50
Activity: 0% Activity: 0% Activity: 0%
 
Join Date: Mar 2002
Posts: 706
Send a message via ICQ to Madgun68 Send a message via MSN to Madgun68
Default Bulk Newsgroup Decoding (was:UUDecode question)

I'm writing some software for myself to bulk decode newsgroups, but there's one thing puzzling me..

Whole messages have a BEGIN and END. On multipart messages, the END may be 10 messages away.

The question I have is this: Is there sure-fire way of determining which parts of a post contains the encoded bits? I know the lines begin with M but what else do I look for? (Line length?)

I'd appreciate any suggestions..
Madgun68 is offline   Reply With Quote
Old 11-11-2003, 03:37 AM   #2
zurt
Too much caffeine
Points: 6,712, Level: 53 Points: 6,712, Level: 53 Points: 6,712, Level: 53
Activity: 0% Activity: 0% Activity: 0%
 
zurt's Avatar
 
Join Date: Feb 2002
Location: Titograd, Socialistična Federativna Republika Jugoslavija
Posts: 100
Default Re: UUDecode question

Yup as Far as I Remember, the structure, was something like that

BEGIN 664 ....
Mxxxxxxxxxxxx
Mxxxxxxxxxxxx
Mxxxxxxxxxxxx
Mxxxxxxxxxxxx
END

AFAIK the line lenght was always the same...

Antonio
__________________
zurtito

AmigaOS user since 1989
MorphOS user since 2003
zurt is offline   Reply With Quote
Old 11-15-2003, 04:02 PM   #3
Madgun68
Cult Member
Points: 6,093, Level: 50 Points: 6,093, Level: 50 Points: 6,093, Level: 50
Activity: 0% Activity: 0% Activity: 0%
 
Join Date: Mar 2002
Posts: 706
Send a message via ICQ to Madgun68 Send a message via MSN to Madgun68
Default Re: UUDecode question

Perhaps it's just paranoia on my part, but I envisioned some [self censored] posting a message that mimics a uuencoded set of messages.

Anyhoo, I've pretty much got it all figured out how to deal with this crap correctly. For multipart messages, the program does the following:

Basically, an entire newsgroup is processed. The "one part" messages are encoded while multiparts are saved to a temp directory. Once the entire group is processed, it goes in the temp directory, finds all parts for a file and sorts them, creates the single part file and decodes it if all the files are present. (If you don't have all the files, it'll just leave them in case you get the rest later.)

What I'm eventually hoping for is two things:
Fetching news at intervals (like every half hour) and temp files that are only stored for a set period. That way, you have x amount of time for the complete set to arrive before it removes the files.

Oh yeah.. And I suppose a gui/prefs at some point would help too. :-)

(And to think.. I'm only doing this because I'm too cheap/can't afford a similar program on the PC. ;-))
Madgun68 is offline   Reply With Quote
Old 11-15-2003, 06:15 PM   #4
T_Bone
Premium Member
Points: 13,012, Level: 74 Points: 13,012, Level: 74 Points: 13,012, Level: 74
Activity: 0% Activity: 0% Activity: 0%
 
Join Date: Jun 2002
Posts: 5,124
Default Re: UUDecode question

> (And to think.. I'm only doing this because I'm too cheap/can't afford a similar program on the PC. )

I use Grabit (for windows) under Winex3 in linux (because the binary downloaders for linux SUCK)
It's free.


T_Bone is offline   Reply With Quote
Old 11-15-2003, 08:02 PM   #5
adolescent
Desperately needs a life
Points: 13,811, Level: 76 Points: 13,811, Level: 76 Points: 13,811, Level: 76
Activity: 7% Activity: 7% Activity: 7%
 
adolescent's Avatar
 
Join Date: Sep 2003
Posts: 3,056
Default Re: UUDecode question

Quote:
T_Bone wrote:
> (And to think.. I'm only doing this because I'm too cheap/can't afford a similar program on the PC. )

I use Grabit (for windows) under Winex3 in linux (because the binary downloaders for linux SUCK)
It's free.
Have you tried BNR? I used this on Windows and also on Linux and haven't found anything better out there.
adolescent is offline   Reply With Quote
Old 11-16-2003, 12:26 AM   #6
CodeSmith
Technoid
Points: 5,817, Level: 49 Points: 5,817, Level: 49 Points: 5,817, Level: 49
Activity: 0% Activity: 0% Activity: 0%
 
Join Date: Sep 2002
Posts: 497
Default Re: UUDecode question

@Madgun68:

Quote:
(And to think.. I'm only doing this because I'm too cheap/can't afford a similar program on the PC. )
Get WinRAR. It will decode uuencoded files (name them whatever.uue), it has a GUI, it will also do lha and its native format is better than ZIP. It's also free :-)
CodeSmith is offline   Reply With Quote
Old 11-16-2003, 12:38 AM   #7
Madgun68
Cult Member
Points: 6,093, Level: 50 Points: 6,093, Level: 50 Points: 6,093, Level: 50
Activity: 0% Activity: 0% Activity: 0%
 
Join Date: Mar 2002
Posts: 706
Send a message via ICQ to Madgun68 Send a message via MSN to Madgun68
Default Re: UUDecode question

Well, I do want a solution for the Amiga/Morphos too. I'm not writing a complete newsreader. This just works with NewsCoaster.

The uudecoding section is (hopefully) complete. I just need to add the ydec stuff and make sure it works on large multi-part stuff.
Madgun68 is offline   Reply With Quote
Old 11-20-2003, 08:01 AM   #8
Madgun68
Cult Member
Points: 6,093, Level: 50 Points: 6,093, Level: 50 Points: 6,093, Level: 50
Activity: 0% Activity: 0% Activity: 0%
 
Join Date: Mar 2002
Posts: 706
Send a message via ICQ to Madgun68 Send a message via MSN to Madgun68
Default Re: Bulk Newsgroup Decoding (was:UUDecode question)

This has been an interesting experience to say the least. There are several bulk yenc encoders that don't properly follow the guidelines that I've had to make adjustments for.. And now I need to make some changes because several of the amiga's uudecoders are ignorant.

The program is working quite well though! I've probably completed 90% of the functionality, and the multipart decoder has been tested with archives that span over hundreds of messages.

Now if I only had a dime for every mistake I've made or every time I've decided to rewrite part of the program..
Madgun68 is offline   Reply With Quote
Reply

Bookmarks

Tags
bulk , decoding , newsgroup , question , wasuudecode

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Mpeg II Decoding Animagic Amiga Hardware Issues and discussion 8 08-20-2006 06:43 AM
Decoding Versions irishmike Amiga Software Issues and Discussion 3 05-24-2006 01:33 PM
Amiga Magazines in bulk ? Edpon General chat about Amiga topics 0 10-16-2005 09:56 PM
Plea for help!! Can't uudecode a crucial file! dandelion Amiga Software Issues and Discussion 2 01-28-2004 04:21 AM
MP3 decoding with SBLive! whabang Alternative Operating Systems 33 03-27-2003 05:50 AM