public inbox for nncp-devel@lists.cypherpunks.ru Atom feed
* [EN] NNCP 7.1.0 release announcement
@ 2021-07-04 17:34 Sergey Matveev
2021-07-05 20:52 ` John Goerzen
0 siblings, 1 reply; 8+ messages in thread
From: Sergey Matveev @ 2021-07-04 17:34 UTC (permalink / raw)
To: nncp-devel
[-- Attachment #1: Type: text/plain, Size: 2576 bytes --]
I am pleased to announce NNCP 7.1.0 release availability!
NNCP (Node to Node copy) is a collection of utilities simplifying
secure store-and-forward files and mail exchanging.
This utilities are intended to help build up small size (dozens of
nodes) ad-hoc friend-to-friend (F2F) statically routed darknet
delay-tolerant networks for fire-and-forget secure reliable files, file
requests, Internet mail and commands transmission. All packets are
integrity checked, end-to-end encrypted (E2EE), explicitly authenticated
by known participants public keys. Onion encryption is applied to
relayed packets. Each node acts both as a client and server, can use
push and poll behaviour model. Also there is multicasting areas support.
Out-of-box offline sneakernet/floppynet, dead drops, sequential and
append-only CD-ROM/tape storages, air-gapped computers support. But
online TCP daemon with full-duplex resumable data transmission exists.
------------------------ >8 ------------------------
The main improvements for that release are:
* Multicasting areas feature appeared. Implemented merely by an
additional plain packet type with "nncp-toss", "nncp-file" and
"nncp-exec" commands modification.
http://www.nncpgo.org/Release-7_005f1_005f0.html
* Fixed workability of "nncp-file" and "nncp-exec" commands, that use
temporary file (stdin and "-use-tmp").
* Fixed disappearing bad return code in "nncp-exec" command.
* Fixed invalid ".hdr" generation when transitional packets are used.
* "-all" option appeared in "nncp-rm" command, applying to all the
nodes at once.
* "-cycle" option appeared in "nncp-check" command, looping the check
in infinite cycle.
* "nncp-rm" command can take node alias name.
* "nncp-pkt" can parse ".hdr" files.
------------------------ >8 ------------------------
NNCP's home page is: http://www.nncpgo.org/
Source code and its signature for that version can be found here:
http://www.nncpgo.org/download/nncp-7.1.0.tar.xz (1142 KiB)
http://www.nncpgo.org/download/nncp-7.1.0.tar.xz.sig
SHA256 hash: D3BC010F 5D86BB59 E07A2A84 2FF9C73B 4C2F780B 807EF25C E4BC477C E40764A6
GPG key ID: 0x2B25868E75A1A953 NNCP releases <releases@nncpgo•org>
Fingerprint: 92C2 F0AE FE73 208E 46BF F3DE 2B25 868E 75A1 A953
Please send questions regarding the use of NNCP, bug reports and patches
to mailing list: http://lists.cypherpunks.ru/nncp_002ddevel.html
--
Sergey Matveev (http://www.stargrave.org/)
OpenPGP: CF60 E89A 5923 1E76 E263 6422 AE1A 8109 E498 57EF
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]
^ permalink raw reply [flat|nested] 8+ messages in thread* Re: [EN] NNCP 7.1.0 release announcement 2021-07-04 17:34 [EN] NNCP 7.1.0 release announcement Sergey Matveev @ 2021-07-05 20:52 ` John Goerzen 2021-07-05 21:26 ` John Goerzen 2021-07-06 9:27 ` Sergey Matveev 0 siblings, 2 replies; 8+ messages in thread From: John Goerzen @ 2021-07-05 20:52 UTC (permalink / raw) To: Sergey Matveev; +Cc: nncp-devel Hi Sergey, Wow, there's a lot exciting in here! The stdin looks better - thanks! I've got a weird nncp-toss issue now, when dealing with received files. It looks like this: Jul 5 15:48:19 datavac nncp-toss[4041]: 2021-07-05T20:48:19Z Got file hi (3 B) from alexandria Jul 5 15:48:19 datavac nncp-toss[4041]: 2021-07-05T20:48:19Z ERROR Tossing file alexandria/ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA (3 B): ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA: dirsyncing: open ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA: no such file or directory Now, nncp-toss here is being run from systemd like so: /usr/local/nncp/bin/nncp-toss -noprogress -cycle 30 -seen If I leave off -seen, then it tosses properly. (This also goes for running directly from the command line). Something about -seen is causing it to break here. It does actually deliver the file... but it does it again and again, on every toss, due to that error. Thanks, - John On Sun, Jul 04 2021, Sergey Matveev wrote: > I am pleased to announce NNCP 7.1.0 release availability! > > NNCP (Node to Node copy) is a collection of utilities > simplifying > secure store-and-forward files and mail exchanging. > > This utilities are intended to help build up small size (dozens > of > nodes) ad-hoc friend-to-friend (F2F) statically routed darknet > delay-tolerant networks for fire-and-forget secure reliable > files, file > requests, Internet mail and commands transmission. All packets > are > integrity checked, end-to-end encrypted (E2EE), explicitly > authenticated > by known participants public keys. Onion encryption is applied > to > relayed packets. Each node acts both as a client and server, can > use > push and poll behaviour model. Also there is multicasting areas > support. > > Out-of-box offline sneakernet/floppynet, dead drops, sequential > and > append-only CD-ROM/tape storages, air-gapped computers support. > But > online TCP daemon with full-duplex resumable data transmission > exists. > > ------------------------ >8 ------------------------ > > The main improvements for that release are: > > * Multicasting areas feature appeared. Implemented merely by an > additional plain packet type with "nncp-toss", "nncp-file" and > "nncp-exec" commands modification. > http://www.nncpgo.org/Release-7_005f1_005f0.html > > * Fixed workability of "nncp-file" and "nncp-exec" commands, > that use > temporary file (stdin and "-use-tmp"). > > * Fixed disappearing bad return code in "nncp-exec" command. > > * Fixed invalid ".hdr" generation when transitional packets are > used. > > * "-all" option appeared in "nncp-rm" command, applying to all > the > nodes at once. > > * "-cycle" option appeared in "nncp-check" command, looping the > check > in infinite cycle. > > * "nncp-rm" command can take node alias name. > > * "nncp-pkt" can parse ".hdr" files. > > ------------------------ >8 ------------------------ > > NNCP's home page is: http://www.nncpgo.org/ > > Source code and its signature for that version can be found > here: > > http://www.nncpgo.org/download/nncp-7.1.0.tar.xz (1142 KiB) > http://www.nncpgo.org/download/nncp-7.1.0.tar.xz.sig > > SHA256 hash: D3BC010F 5D86BB59 E07A2A84 2FF9C73B 4C2F780B > 807EF25C E4BC477C E40764A6 > GPG key ID: 0x2B25868E75A1A953 NNCP releases > <releases@nncpgo•org> > Fingerprint: 92C2 F0AE FE73 208E 46BF F3DE 2B25 868E 75A1 A953 > > Please send questions regarding the use of NNCP, bug reports and > patches > to mailing list: http://lists.cypherpunks.ru/nncp_002ddevel.html ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [EN] NNCP 7.1.0 release announcement 2021-07-05 20:52 ` John Goerzen @ 2021-07-05 21:26 ` John Goerzen 2021-07-05 21:38 ` John Goerzen 2021-07-06 9:27 ` Sergey Matveev 1 sibling, 1 reply; 8+ messages in thread From: John Goerzen @ 2021-07-05 21:26 UTC (permalink / raw) To: Sergey Matveev; +Cc: nncp-devel I spoke too soon on the stdin. It appears to be truncating certain small files. I am wrapping everything in gpg, and it is detecting truncation during verification (or the decrypted data is truncated). This is with nncp-file - Thanks again, John On Mon, Jul 05 2021, John Goerzen wrote: > Hi Sergey, > > Wow, there's a lot exciting in here! > > The stdin looks better - thanks! > > I've got a weird nncp-toss issue now, when dealing with received > files. > > It looks like this: > > Jul 5 15:48:19 datavac nncp-toss[4041]: 2021-07-05T20:48:19Z > Got file hi (3 B) > from alexandria > Jul 5 15:48:19 datavac nncp-toss[4041]: 2021-07-05T20:48:19Z > ERROR Tossing file > alexandria/ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA > (3 B): > ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA: > dirsyncing: open > ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA: no such > file or directory > > Now, nncp-toss here is being run from systemd like so: > > /usr/local/nncp/bin/nncp-toss -noprogress -cycle 30 -seen > > If I leave off -seen, then it tosses properly. (This also goes > for running > directly from the command line). > > Something about -seen is causing it to break here. > > It does actually deliver the file... but it does it again and > again, on every > toss, due to that error. > > Thanks, > > - John > > On Sun, Jul 04 2021, Sergey Matveev wrote: > >> I am pleased to announce NNCP 7.1.0 release availability! >> >> NNCP (Node to Node copy) is a collection of utilities >> simplifying >> secure store-and-forward files and mail exchanging. >> >> This utilities are intended to help build up small size (dozens >> of >> nodes) ad-hoc friend-to-friend (F2F) statically routed darknet >> delay-tolerant networks for fire-and-forget secure reliable >> files, file >> requests, Internet mail and commands transmission. All packets >> are >> integrity checked, end-to-end encrypted (E2EE), explicitly >> authenticated >> by known participants public keys. Onion encryption is applied >> to >> relayed packets. Each node acts both as a client and server, >> can use >> push and poll behaviour model. Also there is multicasting areas >> support. >> >> Out-of-box offline sneakernet/floppynet, dead drops, sequential >> and >> append-only CD-ROM/tape storages, air-gapped computers support. >> But >> online TCP daemon with full-duplex resumable data transmission >> exists. >> >> ------------------------ >8 ------------------------ >> >> The main improvements for that release are: >> >> * Multicasting areas feature appeared. Implemented merely by >> an >> additional plain packet type with "nncp-toss", "nncp-file" >> and >> "nncp-exec" commands modification. >> http://www.nncpgo.org/Release-7_005f1_005f0.html >> >> * Fixed workability of "nncp-file" and "nncp-exec" commands, >> that use >> temporary file (stdin and "-use-tmp"). >> >> * Fixed disappearing bad return code in "nncp-exec" command. >> >> * Fixed invalid ".hdr" generation when transitional packets are >> used. >> >> * "-all" option appeared in "nncp-rm" command, applying to all >> the >> nodes at once. >> >> * "-cycle" option appeared in "nncp-check" command, looping the >> check >> in infinite cycle. >> >> * "nncp-rm" command can take node alias name. >> >> * "nncp-pkt" can parse ".hdr" files. >> >> ------------------------ >8 ------------------------ >> >> NNCP's home page is: http://www.nncpgo.org/ >> >> Source code and its signature for that version can be found >> here: >> >> http://www.nncpgo.org/download/nncp-7.1.0.tar.xz (1142 KiB) >> http://www.nncpgo.org/download/nncp-7.1.0.tar.xz.sig >> >> SHA256 hash: D3BC010F 5D86BB59 E07A2A84 2FF9C73B 4C2F780B >> 807EF25C E4BC477C >> E40764A6 >> GPG key ID: 0x2B25868E75A1A953 NNCP releases >> <releases@nncpgo•org> >> Fingerprint: 92C2 F0AE FE73 208E 46BF F3DE 2B25 868E 75A1 A953 >> >> Please send questions regarding the use of NNCP, bug reports >> and patches >> to mailing list: >> http://lists.cypherpunks.ru/nncp_002ddevel.html ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [EN] NNCP 7.1.0 release announcement 2021-07-05 21:26 ` John Goerzen @ 2021-07-05 21:38 ` John Goerzen 2021-07-06 9:57 ` Sergey Matveev 0 siblings, 1 reply; 8+ messages in thread From: John Goerzen @ 2021-07-05 21:38 UTC (permalink / raw) To: Sergey Matveev; +Cc: nncp-devel Some more detail on this: The files were about 700-950 bytes in length. It happened in quick succession on one machine. If you have trouble duplicating, I will try to set up a test installation and see if I can whip up a demo case. What's odd is that it corrupted about 5 out of 15 files that were generated at the time -- and they were all small ones. The bigger ones were fine. - John On Mon, Jul 05 2021, John Goerzen wrote: > I spoke too soon on the stdin. > > It appears to be truncating certain small files. I am wrapping > everything in > gpg, and it is detecting truncation during verification (or the > decrypted data > is truncated). This is with nncp-file - > > Thanks again, > > John > > On Mon, Jul 05 2021, John Goerzen wrote: > >> Hi Sergey, >> >> Wow, there's a lot exciting in here! >> >> The stdin looks better - thanks! >> >> I've got a weird nncp-toss issue now, when dealing with >> received files. >> >> It looks like this: >> >> Jul 5 15:48:19 datavac nncp-toss[4041]: 2021-07-05T20:48:19Z >> Got file hi (3 >> B) >> from alexandria >> Jul 5 15:48:19 datavac nncp-toss[4041]: 2021-07-05T20:48:19Z >> ERROR Tossing >> file >> alexandria/ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA >> (3 B): >> ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA: >> dirsyncing: open >> ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA: no such >> file or >> directory >> >> Now, nncp-toss here is being run from systemd like so: >> >> /usr/local/nncp/bin/nncp-toss -noprogress -cycle 30 -seen >> >> If I leave off -seen, then it tosses properly. (This also goes >> for running >> directly from the command line). >> >> Something about -seen is causing it to break here. >> >> It does actually deliver the file... but it does it again and >> again, on every >> toss, due to that error. >> >> Thanks, >> >> - John >> >> On Sun, Jul 04 2021, Sergey Matveev wrote: >> >>> I am pleased to announce NNCP 7.1.0 release availability! >>> >>> NNCP (Node to Node copy) is a collection of utilities >>> simplifying >>> secure store-and-forward files and mail exchanging. >>> >>> This utilities are intended to help build up small size >>> (dozens of >>> nodes) ad-hoc friend-to-friend (F2F) statically routed darknet >>> delay-tolerant networks for fire-and-forget secure reliable >>> files, file >>> requests, Internet mail and commands transmission. All packets >>> are >>> integrity checked, end-to-end encrypted (E2EE), explicitly >>> authenticated >>> by known participants public keys. Onion encryption is applied >>> to >>> relayed packets. Each node acts both as a client and server, >>> can use >>> push and poll behaviour model. Also there is multicasting >>> areas support. >>> >>> Out-of-box offline sneakernet/floppynet, dead drops, >>> sequential and >>> append-only CD-ROM/tape storages, air-gapped computers >>> support. But >>> online TCP daemon with full-duplex resumable data transmission >>> exists. >>> >>> ------------------------ >8 ------------------------ >>> >>> The main improvements for that release are: >>> >>> * Multicasting areas feature appeared. Implemented merely by >>> an >>> additional plain packet type with "nncp-toss", "nncp-file" >>> and >>> "nncp-exec" commands modification. >>> http://www.nncpgo.org/Release-7_005f1_005f0.html >>> >>> * Fixed workability of "nncp-file" and "nncp-exec" commands, >>> that use >>> temporary file (stdin and "-use-tmp"). >>> >>> * Fixed disappearing bad return code in "nncp-exec" command. >>> >>> * Fixed invalid ".hdr" generation when transitional packets >>> are used. >>> >>> * "-all" option appeared in "nncp-rm" command, applying to all >>> the >>> nodes at once. >>> >>> * "-cycle" option appeared in "nncp-check" command, looping >>> the check >>> in infinite cycle. >>> >>> * "nncp-rm" command can take node alias name. >>> >>> * "nncp-pkt" can parse ".hdr" files. >>> >>> ------------------------ >8 ------------------------ >>> >>> NNCP's home page is: http://www.nncpgo.org/ >>> >>> Source code and its signature for that version can be found >>> here: >>> >>> http://www.nncpgo.org/download/nncp-7.1.0.tar.xz (1142 >>> KiB) >>> http://www.nncpgo.org/download/nncp-7.1.0.tar.xz.sig >>> >>> SHA256 hash: D3BC010F 5D86BB59 E07A2A84 2FF9C73B 4C2F780B >>> 807EF25C E4BC477C >>> E40764A6 >>> GPG key ID: 0x2B25868E75A1A953 NNCP releases >>> <releases@nncpgo•org> >>> Fingerprint: 92C2 F0AE FE73 208E 46BF F3DE 2B25 868E 75A1 >>> A953 >>> >>> Please send questions regarding the use of NNCP, bug reports >>> and patches >>> to mailing list: >>> http://lists.cypherpunks.ru/nncp_002ddevel.html ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [EN] NNCP 7.1.0 release announcement 2021-07-05 21:38 ` John Goerzen @ 2021-07-06 9:57 ` Sergey Matveev 2021-07-07 1:30 ` John Goerzen 0 siblings, 1 reply; 8+ messages in thread From: Sergey Matveev @ 2021-07-06 9:57 UTC (permalink / raw) To: nncp-devel [-- Attachment #1: Type: text/plain, Size: 1420 bytes --] *** John Goerzen [2021-07-05 16:38]: >What's odd is that it corrupted about 5 out of 15 files that were generated >at the time -- and they were all small ones. The bigger ones were fine. Currently I can not reproduce that issue locally. I use "nncp-exec -" analogue for all my email -- have never seen that kind of issues. I creates a subset of relatively small various files with fio. 1000 files of 100-2000 bytes sizes: % cat foo.fio [mein] readwrite=write bssplit=100/:500/:1000/:1500/:2000/ nrfiles=1000 filesize=100-2000 Then I passed them through gpg and nncp-file -: for i (mein.0.*) gpg -r offline -e < $i | nncp-file - self:$i.gpg and tossed: nncp-xfer -mkdir -node self /tmp/self-shared nncp-xfer -node self /tmp/self-shared nncp-toss And then decrypted and checked if all the data is "undamaged": cd ~/incoming for i (*.gpg) gpg -d < $i > $i:r l *~*.gpg | sort | xargs cat | sha1 cd fiodir l mein.0.* | sort | xargs cat | sha1 And all hashes are matched, no gpg errors. I looked at the NNCP's code again and currently see nothing like some kind of unflushed bufio-buffers and that code has not been touched for a long time. Unfortunately currently I have got no ideas how to reproduce the problem. -- Sergey Matveev (http://www.stargrave.org/) OpenPGP: CF60 E89A 5923 1E76 E263 6422 AE1A 8109 E498 57EF [-- Attachment #2: signature.asc --] [-- Type: application/pgp-signature, Size: 833 bytes --] ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [EN] NNCP 7.1.0 release announcement 2021-07-06 9:57 ` Sergey Matveev @ 2021-07-07 1:30 ` John Goerzen 2021-07-07 19:15 ` Sergey Matveev 0 siblings, 1 reply; 8+ messages in thread From: John Goerzen @ 2021-07-07 1:30 UTC (permalink / raw) To: Sergey Matveev; +Cc: nncp-devel On Tue, Jul 06 2021, Sergey Matveev wrote: > *** John Goerzen [2021-07-05 16:38]: >>What's odd is that it corrupted about 5 out of 15 files that >>were generated >>at the time -- and they were all small ones. The bigger ones >>were fine. > > Currently I can not reproduce that issue locally. I use > "nncp-exec -" > analogue for all my email -- have never seen that kind of > issues. Thank you for 7.1.1! This release is now working perfectly for me! I am excited to try out the multicast stuff now. I dug into this some more. I was able to reproduce it, but I now know why you couldn't. It was, in fact, not actually introducing corruption but somehow re-delivering files that had been sent a day or two ago. Why, I have no idea. How, I also have no idea. Where, I don't know either. But once those got flushed out of the system, everything was fine. No more dupes so far. grumble grumble about ZFS's error message "cannot receive: failed to read from stream". I eventually was able to verify sha256sums matched, and then turned on zfs receive -v for verbose mode... and the error was basically attempting to receive a snapshot that was already present. It was an old nncp-file packet that somehow got re-delivered and re-processed, and the same went for all the others also. I am sorry to have sent you on the wrong chase for that! - John ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [EN] NNCP 7.1.0 release announcement 2021-07-07 1:30 ` John Goerzen @ 2021-07-07 19:15 ` Sergey Matveev 0 siblings, 0 replies; 8+ messages in thread From: Sergey Matveev @ 2021-07-07 19:15 UTC (permalink / raw) To: nncp-devel [-- Attachment #1: Type: text/plain, Size: 283 bytes --] *** John Goerzen [2021-07-06 20:30]: >I am sorry to have sent you on the wrong chase for that! No problem :-). There can not be too much additional testing involved. -- Sergey Matveev (http://www.stargrave.org/) OpenPGP: CF60 E89A 5923 1E76 E263 6422 AE1A 8109 E498 57EF [-- Attachment #2: signature.asc --] [-- Type: application/pgp-signature, Size: 833 bytes --] ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [EN] NNCP 7.1.0 release announcement 2021-07-05 20:52 ` John Goerzen 2021-07-05 21:26 ` John Goerzen @ 2021-07-06 9:27 ` Sergey Matveev 1 sibling, 0 replies; 8+ messages in thread From: Sergey Matveev @ 2021-07-06 9:27 UTC (permalink / raw) To: nncp-devel [-- Attachment #1: Type: text/plain, Size: 424 bytes --] Greetings! *** John Goerzen [2021-07-05 15:52]: >ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA: dirsyncing: open >ZEQV4GZMI2NZJJ5RSJTV245C35UZ3BT4K2I4VXOTTGP62XKFSISA: no such file or >directory Fixed in 7.1.1. Thanks for the report! Sorry that that. Really need to make many functional tests. -- Sergey Matveev (http://www.stargrave.org/) OpenPGP: CF60 E89A 5923 1E76 E263 6422 AE1A 8109 E498 57EF [-- Attachment #2: signature.asc --] [-- Type: application/pgp-signature, Size: 833 bytes --] ^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2021-07-07 19:15 UTC | newest] Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2021-07-04 17:34 [EN] NNCP 7.1.0 release announcement Sergey Matveev 2021-07-05 20:52 ` John Goerzen 2021-07-05 21:26 ` John Goerzen 2021-07-05 21:38 ` John Goerzen 2021-07-06 9:57 ` Sergey Matveev 2021-07-07 1:30 ` John Goerzen 2021-07-07 19:15 ` Sergey Matveev 2021-07-06 9:27 ` Sergey Matveev