jo wrote in message <1097855874.29410.9@ersa.uk.clara.net>,
I thought it was just that the Berlin server was burping. But you are each
on two other servers. So, yeah, something most strange is going on.

I had to use news.readfreenews.net [1] to see these recent posts.

I kind of doubt that this post [2], sent out from the Berlin server, will
propagate well any time soon. But what the heck.


________
[1]
news.readfreenews.net
- read-only
- no password req
- as complete as individual.net (Berlin) -- and at the moment, more so.

[2]
Btw, I couldn't do much about building the correct references header to
post this message. Not without using a different reader, else searching
through Agent heX0r faqs.


--
Karen S.

jo <kisei@lineone.net>:
It's like somewhere on the highway there was a DUI checkpoint, causing
a massive traffic backup.

Egad. I've used Agent for about a century now, with import/exports part
of my common routine, so have no excuses, that the logical, sensible answer
entirely eluded me. Flunked the pop quiz with a D'OH! grade...


--
Karen S.

omega wrote in <ps42n0hn8dqt9vej2n71lg82raodch3sh3@4ax.com>:

Something to play with, when you have a folder w/ thousands of
messages. Select all messages in folder, do a save as. Then do another
save from the same folder/same messages, using a different name, but
now in the save as dialog, instead of raw format try:

FILE FORMAT:
[ ] Unix message file
[X] Precede each message with:
From ???@??? Mon Jan 01 00:00:00 1996\n
[ ] No separator between messages

HEADER FIELDS TO INCLUDE
[ ] All fields
[X] Selected fields:

Date,Newsgroups,To,From,Subject,Message-ID,References,MIME-Version,Content-Type,
[ ] No fields (body only]

Result, example: Saving as raw message file, 6000 messages resulted in
a 11MB message file. Then saving the same messages with the above
header filters included, 7,7MB. So much for the overhead/headers (btw
I have the mime/content headers in there since I have also used this
export/import for e-mail, don't think you need it for plaintext news
messages. If you try, import to a new folder first and compare/browse
the two before you delte the old Only major problem is that
reading/import from file is VERY slow. Not something I do often in
other words

Btw, when/if you have the "save as" message file out there, you might
also wantto remove dupes and save another few kb <g>,
see this thread:
<http://google.com/groups?&threadm=ree0fvoc39rrh46udp9pd6223mi0tljuo8 %404ax.com&rnum=1&prev>

Again, not something I do often (given plenty of cheap storage space),
but very handy when I need it. Say if by mistake I've copied the same
messages twice to the same folder (ignoring Agents prompt) and deleted
the source folder(s)..I am not talking about just one or ten messages
here,but many...

PS: experienced same problem with the feed as you guys, with two
different servers. Not investigated, usually these things "go away"
- we hope.

All the best,
Bjorn Simonsen

Bjorn Simonsen <bsusenet@hotmail.com>:
Bjorn, I'll go investigate. But first, right off, I want to thank you for
magically guessing a major need I've had. I have the dupes problem and it
has long bothered me, not knowing how to address it. The only solution I'd
been able to come up with (not acted upon yet though) was to do mbox files
import into the $$$Bat, since that has an eliminate dupes function built in.
Right now, taking first look at the info you've pointed to, that looks to be
a road that will be far more satisfying.

Btw, I get the dupes often as result of the way Agent's import dialog has
tricked me so many times. One has a folder selected, then in the import
dialog box, chooses a file to import, basically expecting it to land in
the active folder. Then hit OK, before realizing, too late -- that one
has forgotten, once again, about Agent's little trap. The way the file
automatically lands in whatever folder it is that happens to be quietly
listed off somewhere near the obscure lower-bottom of that accursed dialog
box.

I've needed for years to take care of the dupes. So thank you so much,
Bjorn, for using your ESP, in order to answer my question without my
needing to write it.


--
Karen S.

omega wrote in <lkc2n0p8en5p2isj1hjvv39vcbvb1q1upu@4ax.com>:

[...]

Exactly the main reasons I ended up looking for a "dupe remover" for
Agent/message files in the first place

No ESP, just similar circumstances and need + a "window of
opportunity" to share the info here when Agent's save as/
import/export was mentioned.

All the best,
Bjorn Simonsen

Bjorn Simonsen <bsusenet@hotmail.com>:
You made that easy! I followed your instructions in your last message in
that thread. That is, I looked for gawk.exe on my drive. Did find a recent
one (2003.04.14), since I'd already had a download of the zip you pointed
out <http://unxutils.sourceforge.net/UnxUtils.zip>.

So I dropped a copy of gawk.exe into a project folder. Then pasted the script
Ralph Fox had created into notepad, and named that file dedup_mbox.awk. Next
put in first a first test file, an mbox file exported rom an Agent folder
that had a dupes problem. Final step, executed this batch:.

gawk -f dedup_mbox.awk file1.mbox >file2.mbox

Immediate success. And the whole kit was assembled in less than ten
minutes. I didn't once have to strain my back by climbing the step-ladder
and reaching on that high shelf for a big, heavy manual.

The script made for a very cool solution to a long-term (years++) problem.
Thank you, Bjorn!


--
Karen S.

omega wrote in <bl5an0l89e0q5fhcqsvggh870os66vbnlf@4ax.com>:

[...]

And thanks to Ralph Fox (regular poster in
<alt.usenet.offline-reader.forte-agent>) who took the time to help me
out by authoring the script, and thanks to the many helpful souls like
him out there! I mean, what would the internet be without them!?

All the best,
Bjorn

Bjorn Simonsen <bsusenet@hotmail.com>:
Void of folks like that and their contributions, what we would have left?
Well, I'd imagine the inet would be reduced to nothing better than a massive
dotcom web mall (w the XP web appliance on wheels for our shopping cart)...


.. . . .
PS. Late mention: Your mbox export method makes sense. After thinking it
over, I can't come think of any reason to store all the extra x-headers, not
the server-added (eg "report abuse to") nor the user-added (avatars, etc).

--
Karen S.