threads / rfc / 18785

patch, 6 partsRe: [PATCH RFC 1/6] send-email: Add --delay for separating emails

Subject: Re: [PATCH RFC 1/6] send-email: Add --delay for separating emails

## tl;dr

15 messages between Apr 8, 2009 and Apr 9, 2009. Diffs are folded; open one to read it.

replies: 14people: 5as markdown or json

Michael Witten· Apr 8, 2009, 14:25 UTC · lore
On Tue, Apr 07, 2009 at 04:25:17PM -0500, Michael Witten wrote:
Show 8 quoted lines
>> When sending a patch series, the emails often arrive at the final
>> destination out of order; though these emails should be chained
>> via the In-Reply-To headers, some mail-viewing systems display
>> by order of arrival instead.
>>
>> The --delay option provides a means for specifying that there
>> should be a certain number of seconds of delay between sending
>> emails, so that the arrival order can be controlled better.
On Tue, Apr 7, 2009 at 16:51, Jeff King wrote:
> I'm a little dubious how well this works in practice. Have you done
> any experiments?

I have indeed, and I got better results. Whether that was a fluke, I can't say for sure.

> [Delivery delays] can be much larger than a few seconds, and this
> won't help at all there.
and
On Tue, Apr 7, 2009 at 18:17, Junio C Hamano wrote:
Show 10 quoted lines
> I do not think giving N second interval at the sending end would
> help much in the real world. Between your submitting MUA (that's
> "git-send-email") and the client MUA, there are many hops involved...
> any single hop can batch the messages that arrive within a small time
> window before passing them to the next hop, and it can reorder the
> messages when it does so.
>
> In short, the only thing your --delay can control is the arrival
> interval at your outgoing MSA. The arrival interval and order of
> messages are outside your control for later hops.

For the most part, yes, I am operating under the assumption that email is sent as soon as it is received by any intervening hop (no batch accumulation). However, I'm also postulating that there always exists an N that serves as an upperbound on the transit time, regardless of batching.

That's where these comment comes into play:
On Tue, Apr 7, 2009 at 16:51, Jeff King wrote:
> The reason I am dubious is that you are presumably delaying only a few
> seconds (since anything more would be quite annoying to the user).
On Wed, Apr 8, 2009 at 01:03:
> A multi-second delay is downright annoying. As a sender, I don't think
> I would enable this option.
However, this sentiment doesn't make sense to me.

Firstly, I presume that someone is electing to use this option, so it is almost by definition not annoying for that person.

Secondly, it seems reasonable to drop into another VC, screen window, or terminal instance, and then set send-email a-running. For instance, with a 14-patch series, one could set `--delay 60' and then let send-email run happily for the next 14 minutes with nary a thought.

However, I think you're coming at it from a different angle:
On Wed, Apr 8, 2009 at 01:03, Jeff King wrote:
Show 8 quoted lines
> But apparently many readers sort by date received. See this subthread:
> 
>  http://article.gmane.org/gmane.comp.version-control.git/110097
> 
> I am generally of the opinion that if it is a big problem for people,
> they should get a better mail client. But I am also open to suggestions
> for helping receivers on crappy mail clients as long as those
> suggestions do not put a burden on the sender.
and
on Tue, Apr 7, 2009 at 17:08, Nicolas Sebrecht wrote:
> If the receiver wants the patch series be in a good ordered _for
> sure_, he has to switch to a client mail supporting the In-Reply-To
> chains.

Frankly, I don't care how other people's patch series appear to me. I care about how mine appear to others. Is this irrational? Probably, but I'm kind of OC; I want my patch series to look like it's in order for everyone.

This has nothing to do with what the receiver wants. This has everything to do with what the sender wants. I want my patch series to be in order even for wrongheaded receivers.

So, I never had any intention of forcing a delay on the sending end. It is strictly for the sending end to use if desired.

On Tue, Apr 7, 2009 at 18:17, Junio C Hamano wrote:
Show 5 quoted lines
> I think send-email already has hacks to timestamp the messages at
> least one-second apart by shifting the Date: field, so that the
> recipient MUA can sort by the departure timestamp if it wants to (and
> if it can), instead of the arrival timestamp. Is it not working well
> for you?
I have worked with 2 major mail clients that both display by date received:
  * Mac OS X's Mail
  * Gmail

I assume that a not-insignificant number of others also use these clients. I don't mind letting send-email run in the background for a few minutes if it means my patch series appear in order.

As you say, Jeff:
Show 8 quoted lines
> On Wed, Apr 08, 2009 at 12:08:54AM +0200, Nicolas Sebrecht wrote:
>> IMHO, this improvement is broken by design. We try to fix a
>> receiver-only issue by a sender side fix.
> 
> I almost said the same thing: it is really the receiver's problem.
> However, that doesn't mean the sender can't do simple things to help
> hint the right thing to the receiver. For example, we already munge the
> date fields to make sure the timestamp in each patch is increasing.

There's nothing simpler than slowing the rate of outgoing email. It doesn't even have to be used; it is completely unintrusive and fully automated. It even works with the confirmation. Best of all, it didn't take much code to implement.

Sincerely, Michael Witten

Michael Witten· Apr 8, 2009, 14:35 UTC · re: Michael Witten · lore
On Wed, Apr 8, 2009 at 09:25, Michael Witten <mfwitten@gmail.com> wrote:
> For instance, with
> a 14-patch series, one could set `--delay 60' and then let send-email
> run happily for the next 14 minutes with nary a thought.
As implemented, it would only take 13 minutes.
For a 5-patch series:
* Patch 1/5 sent
* delay 60 seconds
* Patch 2/5 sent
* delay 60 seconds
* Patch 3/5 sent
* delay 60 seconds
* Patch 4/5 sent
* delay 60 seconds
* Patch 5/5 sent
* send email exits immediately
Jeff King· Apr 9, 2009, 08:14 UTC · re: Michael Witten · lore
On Wed, Apr 08, 2009 at 09:25:25AM -0500, Michael Witten wrote:
> Firstly, I presume that someone is electing to use this option, so it is
> almost by definition not annoying for that person.

Sure, obviously only people who enable it will be affected. I was thinking of it more in terms of group economics: how many people _will_ enable it, because they think the payoff outweighs the annoyance.

And perhaps you can argue that it has negligible group cost. The code is small and not likely to introduce new bugs. So the only costs are whatever any sender is willing to pay themselves. And in that sense, if even one person uses it, it is a net win.

> Secondly, it seems reasonable to drop into another VC, screen window, or
> terminal instance, and then set send-email a-running. For instance, with
> a 14-patch series, one could set `--delay 60' and then let send-email
> run happily for the next 14 minutes with nary a thought.

Except for your 10-minute "no activity, so let's suspend to ram" timeout. ;) But I think we can assume since the user is opting in to the feature that they don't have a problem with it.

> Frankly, I don't care how other people's patch series appear to me. I care
> about how mine appear to others. Is this irrational? Probably, but I'm kind
> of OC; I want my patch series to look like it's in order for everyone.

No, it's not irrational. We spend time proofreading, cleaning up patches, etc, because we know other people will read them. And a little effort by the sender can often save a lot of effort by many readers. And people do it out of politeness, perhaps, or altruism, or simply because it encourages others to spend the effort for them.

But I would personally find such a delay annoying (especially 60 seconds, which I consider to be huge), and I feel that by threading and using sane date fields, I have done enough for the reader.

> I have worked with 2 major mail clients that both display by date received:
> 
>   * Mac OS X's Mail
>   * Gmail

Somebody reported in the thread I referenced earlier that gmane's web interface has the same problem; I didn't check it myself, though.

> There's nothing simpler than slowing the rate of outgoing email. It doesn't
> even have to be used; it is completely unintrusive and fully automated. It
> even works with the confirmation. Best of all, it didn't take much code to
> implement.

I disagree that it's unintrusive (and I understand that you don't think it is, and that there may be others like you, but I am pointing out there are others who think the opposite). But given that it's optional, and it's not very much code, I don't have a strong objection. My original comment was that I was dubious whether it would work: however, I was thinking you would set it to a few seconds. Setting it to 60 seconds, I can imagine it would have an impact.

-Peff
Junio C Hamano· Apr 9, 2009, 08:49 UTC · re: Jeff King · lore
Jeff King <peff@peff.net> writes:
Show 7 quoted lines
> I disagree that it's unintrusive (and I understand that you don't think
> it is, and that there may be others like you, but I am pointing out
> there are others who think the opposite). But given that it's optional,
> and it's not very much code, I don't have a strong objection. My
> original comment was that I was dubious whether it would work: however,
> I was thinking you would set it to a few seconds. Setting it to 60
> seconds, I can imagine it would have an impact.

Heh, then why not make the option specify the number of _minutes_ not seconds to delay? That would help clarifying what this option is meant to do.

The description for this new feature in the manual page should make it absolutely clear that the maintainer who accepts such a feature is not clueless to think that such a delay will guarantee something. It is merely for people who believe it would help guaranteeing the delivery order _in practice_ and are willing to background the slow sending.

Nicolas Pitre· Apr 9, 2009, 17:51 UTC · re: Junio C Hamano · lore
On Thu, 9 Apr 2009, Junio C Hamano wrote:
Show 13 quoted lines
> Jeff King <peff@peff.net> writes:
> 
> > I disagree that it's unintrusive (and I understand that you don't think
> > it is, and that there may be others like you, but I am pointing out
> > there are others who think the opposite). But given that it's optional,
> > and it's not very much code, I don't have a strong objection. My
> > original comment was that I was dubious whether it would work: however,
> > I was thinking you would set it to a few seconds. Setting it to 60
> > seconds, I can imagine it would have an impact.
> 
> Heh, then why not make the option specify the number of _minutes_ not
> seconds to delay?  That would help clarifying what this option is meant to
> do.

Maybe only a few seconds is all that is needed in some circumstances. For the issue I just posted, I wouldn't use it at all if the minimum delay was one minute.

Nicolas
Nicolas Pitre· Apr 9, 2009, 17:48 UTC · re: Jeff King · lore
On Thu, 9 Apr 2009, Jeff King wrote:
Show 8 quoted lines
> On Wed, Apr 08, 2009 at 09:25:25AM -0500, Michael Witten wrote:
> 
> > Firstly, I presume that someone is electing to use this option, so it is
> > almost by definition not annoying for that person.
> 
> Sure, obviously only people who enable it will be affected. I was
> thinking of it more in terms of group economics: how many people _will_
> enable it, because they think the payoff outweighs the annoyance.

My ISP doesn't allow me to send more than 20 emails at once. So if a patch series has more than 20 patches, send-email will be denied the sending of the end of the series, which is rather anoying.

I didn't test this option (have no large patch series to post at the moment), but if it could allow me to easily work around the ISP restriction then I would be happy.

Nicolas
Junio C Hamano· Apr 9, 2009, 19:28 UTC · re: Nicolas Pitre · lore
Nicolas Pitre <nico@cam.org> writes:
Show 12 quoted lines
> On Thu, 9 Apr 2009, Jeff King wrote:
>
>> On Wed, Apr 08, 2009 at 09:25:25AM -0500, Michael Witten wrote:
>> 
>> > Firstly, I presume that someone is electing to use this option, so it is
>> > almost by definition not annoying for that person.
>> 
>> Sure, obviously only people who enable it will be affected. I was
>> thinking of it more in terms of group economics: how many people _will_
>> enable it, because they think the payoff outweighs the annoyance.
>
> My ISP doesn't allow me to send more than 20 emails at once.

Hmm, I first thought you meant 20 emails in a single smtp session, but it appears that we create a new instance of Net::SMTP for each piece of email so it really sounds like it is time based (N pieces of e-mail within M minutes).

Perhaps --pause=N,M to say "Pause N seconds for every M messages", where Michael's --delay=N is just a shorthand for --pause=N,1 is what you want? That is, reset the counter to 0 at the beginning, increment it after sending each message, and when the counter is M and if you have more to send, you wait for N seconds and reset the counter to 0. Then when you have a series smaller than 20 you won't have to suffer from any artificial delay.

Nicolas Pitre· Apr 9, 2009, 19:36 UTC · re: Junio C Hamano · lore
On Thu, 9 Apr 2009, Junio C Hamano wrote:
Show 27 quoted lines
> Nicolas Pitre <nico@cam.org> writes:
> 
> > On Thu, 9 Apr 2009, Jeff King wrote:
> >
> >> On Wed, Apr 08, 2009 at 09:25:25AM -0500, Michael Witten wrote:
> >> 
> >> > Firstly, I presume that someone is electing to use this option, so it is
> >> > almost by definition not annoying for that person.
> >> 
> >> Sure, obviously only people who enable it will be affected. I was
> >> thinking of it more in terms of group economics: how many people _will_
> >> enable it, because they think the payoff outweighs the annoyance.
> >
> > My ISP doesn't allow me to send more than 20 emails at once.
> 
> Hmm, I first thought you meant 20 emails in a single smtp session, but it
> appears that we create a new instance of Net::SMTP for each piece of email
> so it really sounds like it is time based (N pieces of e-mail within M
> minutes).
> 
> Perhaps --pause=N,M to say "Pause N seconds for every M messages", where
> Michael's --delay=N is just a shorthand for --pause=N,1 is what you want?
> That is, reset the counter to 0 at the beginning, increment it after
> sending each message, and when the counter is M and if you have more to
> send, you wait for N seconds and reset the counter to 0.  Then when you
> have a series smaller than 20 you won't have to suffer from any artificial
> delay.
I suppose that would work fine too.
Nicolas
Michael Witten· Apr 9, 2009, 20:59 UTC · re: Junio C Hamano · lore
Show 6 quoted lines
>> My ISP doesn't allow me to send more than 20 emails at once.
>
> Hmm, I first thought you meant 20 emails in a single smtp session, but it
> appears that we create a new instance of Net::SMTP for each piece of email
> so it really sounds like it is time based (N pieces of e-mail within M
> minutes).

Actually, there is a lot of ||= going on in there, so it would seem that only one smtp session is created; the weird thing is that STARTTLS and $smtp->hello() are run each time through send_message(), which I think is probably wrong. If it works, then I imagine it's just superfluous.

In any case, if his ISP doesn't like him sending more than 20 emails per session, then it certainly won't like 1 session per email.

Show 7 quoted lines
> Perhaps --pause=N,M to say "Pause N seconds for every M messages", where
> Michael's --delay=N is just a shorthand for --pause=N,1 is what you want?
> That is, reset the counter to 0 at the beginning, increment it after
> sending each message, and when the counter is M and if you have more to
> send, you wait for N seconds and reset the counter to 0.  Then when you
> have a series smaller than 20 you won't have to suffer from any artificial
> delay.
This sounds reasonable, but I would have:
    --rate=M/N
Michael Witten
Michael Witten· Apr 9, 2009, 21:02 UTC · re: Michael Witten · lore
On Thu, Apr 9, 2009 at 15:59, Michael Witten <mfwitten@gmail.com> wrote:
Show 11 quoted lines
>> Perhaps --pause=N,M to say "Pause N seconds for every M messages", where
>> Michael's --delay=N is just a shorthand for --pause=N,1 is what you want?
>> That is, reset the counter to 0 at the beginning, increment it after
>> sending each message, and when the counter is M and if you have more to
>> send, you wait for N seconds and reset the counter to 0.  Then when you
>> have a series smaller than 20 you won't have to suffer from any artificial
>> delay.
>
> This sounds reasonable, but I would have:
>
>    --rate=M/N
I take that back. Clearly `rate' connotes an average rather than a burst.
Nicolas Sebrecht· Apr 9, 2009, 16:17 UTC · re: Michael Witten · lore

[PATCH RFC 1/6] Re: send-email: Add --delay for separating emails

On Wed, Apr 08, 2009 at 09:25:25AM -0500, Michael Witten wrote:
> This has nothing to do with what the receiver wants. This has everything
> to do with what the sender wants. I want my patch series to be in order
> even for wrongheaded receivers.

The --delay option may have an undesirable side effect. In case of non-chained emails, unrelated mails could be insterted between patches where *all* MUA would be affected. It's not only true for very high volume message mailing-lists (million monkeys receiving...). FMPOV, it's worse than all display issues we already know or have with the current behaviour.

-- 
Nicolas Sebrecht
Michael Witten· Apr 9, 2009, 17:27 UTC · re: Nicolas Sebrecht · lore

Re: [PATCH RFC 1/6] Re: send-email: Add --delay for separating emails

On Thu, Apr 9, 2009 at 11:17, Nicolas Sebrecht <nicolas.s-dev@laposte.net> wrote:

Show 7 quoted lines
>
> The --delay option may have an undesirable side effect. In case of
> non-chained emails, unrelated mails could be insterted between patches
> where *all* MUA would be affected. It's not only true for very high
> volume message mailing-lists (million monkeys receiving...). FMPOV, it's
> worse than all display issues we already know or have with the current
> behaviour.

But it's already impossible to protect against this scenario. In that situation, the smallest delay possible is desired, so --delay wouldn't even be used (that is, its value would be zero). However, the transit delay could never be small enough to guarantee that no other emails are inserted into the patch series, so the only solution is to chain them. At this point, we're back to the problem of arrival time, and hence --delay becomes useful.

:-D
Michael Witten· Apr 9, 2009, 17:38 UTC · re: Michael Witten · lore

Re: [PATCH RFC 1/6] Re: send-email: Add --delay for separating emails

On Thu, Apr 9, 2009 at 12:27, Michael Witten <mfwitten@gmail.com> wrote:
Show 17 quoted lines
> On Thu, Apr 9, 2009 at 11:17, Nicolas Sebrecht
> <nicolas.s-dev@laposte.net> wrote:
>>
>> The --delay option may have an undesirable side effect. In case of
>> non-chained emails, unrelated mails could be insterted between patches
>> where *all* MUA would be affected. It's not only true for very high
>> volume message mailing-lists (million monkeys receiving...). FMPOV, it's
>> worse than all display issues we already know or have with the current
>> behaviour.
>
> But it's already impossible to protect against this scenario. In that
> situation, the smallest delay possible is desired, so --delay wouldn't
> even be used (that is, its value would be zero). However, the transit
> delay could never be small enough to guarantee that no other emails
> are inserted into the patch series, so the only solution is to chain
> them. At this point, we're back to the problem of arrival time, and
> hence --delay becomes useful.
I do agree that --delay could exacerbate the spreading out of patches.
Nicolas Sebrecht· Apr 9, 2009, 17:45 UTC · re: Michael Witten · lore

[PATCH RFC 1/6] Re: send-email: Add --delay for separating emails

On Thu, Apr 09, 2009 at 12:27:18PM -0500, Michael Witten wrote:
Show 12 quoted lines
> 
> On Thu, Apr 9, 2009 at 11:17, Nicolas Sebrecht
> <nicolas.s-dev@laposte.net> wrote:
> >
> > The --delay option may have an undesirable side effect. In case of
> > non-chained emails, unrelated mails could be insterted between patches
> > where *all* MUA would be affected. It's not only true for very high
> > volume message mailing-lists (million monkeys receiving...). FMPOV, it's
> > worse than all display issues we already know or have with the current
> > behaviour.
> 
> But it's already impossible to protect against this scenario.

But we could forbid the use of --delay with non-chained emails, no? Or at least, warn it should not be used.

-- 
Nicolas Sebrecht
Michael Witten· Apr 9, 2009, 18:43 UTC · re: Nicolas Sebrecht · lore

Re: [PATCH RFC 1/6] Re: send-email: Add --delay for separating emails

On Thu, Apr 9, 2009 at 12:45, Nicolas Sebrecht <nicolas.s-dev@laposte.net> wrote:

> But we could forbid the use of --delay with non-chained emails, no? Or
> at least, warn it should not be used.
Ah! Good point! I'll add that.

← back to recent threads