public inbox for nncp-devel@lists.cypherpunks.ru
Atom feed
* onlinedeadline prevents checksum from running
@ 2021-05-10 2:22 John Goerzen
2021-05-10 3:36 ` John Goerzen
` (2 more replies)
0 siblings, 3 replies; 4+ messages in thread
From: John Goerzen @ 2021-05-10 2:22 UTC (permalink / raw)
To: nncp-devel
Hi Sergey,
Three bug reports in one weekend. Sorry about that :-)
So I have a situation where I was receiving a 250GB packet. I'm
not quite sure why it got interrupted -- it seems maybe a locking
issue with nncp-toss -- but anyhow, it did. I was running
nncp-call -onlinedeadline 10 in a loop (making sure to download
all the packets from the remote). I noticed it wasn't progressing
-- getting about 2GB in and then hanging. Why was that?
It was the -onlinedeadline 10. Got rid of that and then it
progressed like it should.
I think there needs to be logic that the checksumming of a
completed packet doesn't get interrupted by the onlinedeadline,
since it could take significantly longer than one might tend to
set the onlinedeadline for.
Thanks!
- John
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: onlinedeadline prevents checksum from running
2021-05-10 2:22 onlinedeadline prevents checksum from running John Goerzen
@ 2021-05-10 3:36 ` John Goerzen
2021-05-10 16:40 ` Sergey Matveev
2021-05-30 16:53 ` Sergey Matveev
2 siblings, 0 replies; 4+ messages in thread
From: John Goerzen @ 2021-05-10 3:36 UTC (permalink / raw)
To: nncp-devel
On Sun, May 09 2021, John Goerzen wrote:
> sure to download all the packets from the remote). I noticed it
> wasn't
> progressing -- getting about 2GB in and then hanging. Why was
> that?
>
> It was the -onlinedeadline 10. Got rid of that and then it
> progressed like it
> should.
I spoke too soon. It got to about 100GB but then still crashed.
(Perhaps a timeout on the remote? Just speculating.)
I wound up using nncp-check -nock, which did get the job done.
Thanks again,
John
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: onlinedeadline prevents checksum from running
2021-05-10 2:22 onlinedeadline prevents checksum from running John Goerzen
2021-05-10 3:36 ` John Goerzen
@ 2021-05-10 16:40 ` Sergey Matveev
2021-05-30 16:53 ` Sergey Matveev
2 siblings, 0 replies; 4+ messages in thread
From: Sergey Matveev @ 2021-05-10 16:40 UTC (permalink / raw)
To: nncp-devel
[-- Attachment #1: Type: text/plain, Size: 384 bytes --]
Greetings, John!
*** John Goerzen [2021-05-09 21:22]:
>Three bug reports in one weekend. Sorry about that :-)
Feedback is always worth of it! I was on a vacation without any computer
and connectivity, so will look on all reported issues at the end of the
week.
--
Sergey Matveev (http://www.stargrave.org/)
OpenPGP: CF60 E89A 5923 1E76 E263 6422 AE1A 8109 E498 57EF
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: onlinedeadline prevents checksum from running
2021-05-10 2:22 onlinedeadline prevents checksum from running John Goerzen
2021-05-10 3:36 ` John Goerzen
2021-05-10 16:40 ` Sergey Matveev
@ 2021-05-30 16:53 ` Sergey Matveev
2 siblings, 0 replies; 4+ messages in thread
From: Sergey Matveev @ 2021-05-30 16:53 UTC (permalink / raw)
To: nncp-devel
[-- Attachment #1: Type: text/plain, Size: 1202 bytes --]
Greetings!
*** John Goerzen [2021-05-09 21:22]:
>why it got interrupted -- it seems maybe a locking issue with nncp-toss
>-- but anyhow, it did. I was running nncp-call -onlinedeadline 10 in a loop
>(making sure to download all the packets from the remote). I noticed it
>wasn't progressing -- getting about 2GB in and then hanging. Why was that?
While trying to hang it up, I met that occasions several times when my
CPU and HDD were heavily pressured, especially with ZFS filesystem and
vfs.zfs.dirty_data_sync=2GiB -- it can buffer up to 2GiB of data, before
trying to release it to the disk. In that cases NNCP timeout can occur.
But that is just highly loaded system and far from being real-time Go's
goroutines scheduling.
>I think there needs to be logic that the checksumming of a completed packet
>doesn't get interrupted by the onlinedeadline, since it could take
>significantly longer than one might tend to set the onlinedeadline for.
I will add waiting of checksumming in next releases. If someone does not
want it, then he should use -nock anyway.
--
Sergey Matveev (http://www.stargrave.org/)
OpenPGP: CF60 E89A 5923 1E76 E263 6422 AE1A 8109 E498 57EF
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2021-05-30 16:53 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-05-10 2:22 onlinedeadline prevents checksum from running John Goerzen
2021-05-10 3:36 ` John Goerzen
2021-05-10 16:40 ` Sergey Matveev
2021-05-30 16:53 ` Sergey Matveev