The Mozilla
Organization
At A Glance
Feedback
Get Involved
Newsgroups
License Terms
Newsbot
Developer Docs
Roadmap
Projects
Ports
Module Owners
Hacking
Get the Source
Build It
Testing
Download
Bugzilla
Bug Writing
Tools
View Source
Tree Status
New Checkins
Submit A Bug
FAQ
Search
Mail Performance Results - Windows

Post feedback to: netscape.public.mozilla.mail-news

General:
Introduction
Test Machine Configuration
Notes
Results:
Startup
POP
IMAP
News
Address Book
Message Compose

Introduction
We are evaluating and testing the performance of various mail tasks. At this time, we are using Communicator 4.7 as a reference to compare the results. Bugs will be filed and tracked for tasks where the performance is not acceptable or slower than 4.7. The builds used are the Netscape commercial builds and the dates of the builds are listed in parenthesis in the results table. We hope to execute these tests on a regular basis as well as add additional mail tasks that can be measured. Improving performance is a continual process and we will be adding more as time goes on!

Test Machine Configurations:

  • Windows:
    • Pentium 133 Mhz
    • 64 MB RAM and 32MB RAM*
    • Windows 95
    • LAN
    • Last Build Tested on 02/23/00.
    *After initial tests were done with 32MB RAM, we increased the memory to 64MB RAM; nothing else on the test machine was changed.
  • Linux: (Click  here  for Latest results)
    • Pentium 133 Mhz
    • 64 MB RAM
    • Red Hat 6.0
    • LAN
    • Last Build Tested on 2/16/00.
  • Mac: (Click  here for latest results)
    • Mac PPC 8.5.1, 150 Mhz.
    • 64 MB RAM
    • LAN
    • Last Build tested on 1/27/00.


    Notes:

    • 2/3/00:  Mail Display slowness is due to bug  26320 .
    • All the time measurements are in seconds.
    • Currently, tests are done manually with a stop watch. Error rate: +/- 1 seconds.
    • Legend:
      • NI - not implemented in the build being tested
      • NT - not testable in the build being tested; reasons provided in parenthesis
      • SD - Standard Deviation of 5 Test runs.
         
    Results:
    No.
    		 Feature/Task Test 4.7 Performance
    (32 MB RAM)    		 4.7 Performance
    (64 MB RAM)    		 Seamonkey Performance
    (02/23/00)
    (64 MB RAM)    		 Seamonkey Performance
    (02/15/00)
    (64 MB RAM)    		 Seamonkey Performance
    (02/09/00)
    (64 MB RAM)
    Mean
    SD
    Mean
    SD
    Mean
    SD
    MailStartup
    1 Mail Startup after Navigator Launch Navigator and then open Mail
    1.68 seconds to password dialog
    		 1.77
    10.646
    0.429
    8.776
    0.095
    11.222
    0.738
    2 Mail Startup First Launch Mail (no other Seamonkey Components are loaded)
    9.20 seconds to password dialog
    7.91
    21.434
    0.734
    16.542
    0.051
    19.908
    0.168
    3 Maximize the Mail Window After starting Mail, maximize the Mail window
    1.84 seconds
    1.43
    3.498
    0.176
    1.834
    0.078
    2.85
    0.062
    POP Mail
    1 POP: Mail Download Download 500 messages (no summary file)
    7.16
    6.19
    9.636
    0.144
    10.6654
    0.278
    14.136
    0.173
    2 POP: Summary File Creation Create summary file for 1,000 message Inbox (summary file does not yet exist)
    11.73
    10.81
    16.202
    0.612
    16.762
    0.979
    20.732
    0.233
    3
    POP: Load Summary File
    		 Load summary file for 1,000 message Inbox (summary file exists)
    3.07
    1.93
    6.336
    0.074
    7.03
    0.106
    8.308
    0.197
    4 POP: Sort Folder Select a folder with 1,000 messages; sort by subject, then reverse the sort order of subject
    1.62
    1.51
    6.802
    0.025
    8.254
    0.139
    12.848
    0.130
    5
    POP: Display 5 Messages without Attachment
    		 Display 5 10-Kb messages that contain HTML formatting
    10.18
    6.73
    37.98
    0.111
    33.64
    0.866
    42.818
    0.675
    6 POP: Display 2 Messages with Attachments Display 2 10-Kb message that each have 100 Kb attachments .
    9.39
    		 . . . .
    110.176
    3.301
    7 POP: File 5 Messages File 5 10-Kb messages from the POP Inbox to a local folder .
    1.08
    6.258
    0.086
    6.772
    0.151
    7.422
    0.751
    8 POP: Delete 5 Messages Delete 5 10-Kb messages from the POP Inbox
    7.32
    5.70
    41.196
    0.359
    37.128
    0.418
    46.51
    0.351
    9 POP: Create New Folder Create a new POP folder .
    0.64
    1.876
    0.053
    1.964
    0.091
    2.1
    0.191
    10 POP: Undo Delete Message In a POP account, select and delete a message, then undo the delete .
    0.65
    1.914
    0.075
    1.894
    0.087
    2.494
    0.120
    11 POP: Scroll Bar In a POP account, select a folder with 500 messages, Scroll to the bottom of the thread pane.
    1. Using arrow button
    2. Dragging the Thumb to the bottom
    3. Scroll be pages.    		 .
    30.45
    1.29
    4.2
    99.258
    2.11
    51.218
    3.714
    0.051
    1.208
    101.204
    2.28
    53.172
    3.7
    0.08
    1.391
    172.604
    2.428
    105.674
    0.941
    0.113
    2.098
    IMAP Mail
    1 IMAP: Header Download Download 1,000 email headers (no summary file)
    20.76 seconds
    19.35
    25.692
    0.186
    24.11
    0.509
    29.984
    0.436
    2 IMAP: Update IMAP Summary File Download an additional 50 headers to an IMAP Inbox that already contains 1,000 headers (summary file exists)
    not set up for this at this time
    		 .
    36.046
    0.282
    29.692
    0.539
    28.954
    1.940
    3 IMAP: Load Summary File Load summary file for 1,000 message Inbox (summary file exists)
    3.42 seconds
    2.64
    7.5
    0.283
    7.736
    0.472
    7.876
    0.277
    4 IMAP: Display 5 Messages without Attachment Display 5 10-Kb messages that contain HTML formatting
    6.77 seconds
    7.01
    39.3
    0.183
    39.86
    0.397
    49.704
    0.455
    5 IMAP: Download and Display 2 Messages with Attachments Download and display 2 10-Kb message that each have 100 Kb attachments
    3.13 seconds when view inline=off
    6.81 seconds when view inline=on
    12.05
    221.83
    3.299
    224.668
    4.134
    229.78
    8.241
    6 IMAP: File 5 Messages File 5 10-Kb messages from the IMAP Inbox to an IMAP folder
    1.7
    1.44
    5.926
    0.226
    4.968
    0.086
    5.528
    0.173
    7 IMAP: Delete 5 Messages Delete 5 10-Kb messages from the IMAP Inbox
    1.8
    7.63
    43.926
    0.172
    43.4
    0.327
    53.294
    0.433
    8 IMAP: Move Messages to Local Folder Move 100 10-Kb Messages from IMAP server to local folder
    10.53
    10.07
    		 . . . . . .
    9 IMAP: Create New IMAP Folder Create a new IMAP folder
    1.5
    1.19
    2.806
    0.0722
    2.112
    0.097
    2.11
    0.087
    10 IMAP: Expand Folder List Select an IMAP account and expand the folder list for that account; the folder list should contain at least 20 folders
    0.30
    0.35
    0.95
    0.038
    1.14
    0.087
    1.106
    0.117
    News
    1 NNTP: Header Download Download 1,000 news headers from NNTP Server (no summary file) .
    9.23
    13.142
    0.421
    13.936
    0.122
    18.04
    0.128
    2 NNTP: Update Summary File Download an additional 50 headers to a newsgroup that already contains 1,000 headers (summary file exists) . . . . . . . .
    3 NNTP: Load Summary File Load summary file for 1,000 message newsgroup (summary file exists) .
    3.85
    8.012
    0.083
    8.18
    0.315
    8.032
    0.233
    4 NNTP: Display 5 Messages Display 5 5-Kb messages (plain text)
    4.11
    3.97
    36.642
    0.767
    38.948
    1.043
    46.842
    1.048
    5 NNTP: Delete Message Delete a news message that you have posted
    3.47
    3.33
    3.002
    0.117
    2.858
    0.068
    2.776
    0.097
    6 NNTP: Mark All Read Mark ~500 News Messages as read .
    1.02
    12.616
    0.266
    11.836
    0.337
    15.448
    0.362
    Address Book
    There is no 'Status Bar' in Address Book. We couldn't test "Open a local address book that contains 200 address book cards" and others at this time.
    1 Open Local Address Book Open a local address book that contains 200 address book cards . . . . . . . .
    2 View 5 Address Book Cards View 5 address book cards (out of a total of 200 cards in the address book) . . . . . . . .
    3 Open "Edit Card" Dialogue Open the Edit Card Dialogue by double clicking on an address book entry .
    0.5
    3.498
    0.139
    3.562
    0.076
    7.02
    0.05
    MessageCompose
    1 Open Compose Window Open the Compose Window
    3.5
    1.43
    5.766
    0.103
    6.222
    0.181
    6.874
    0.1
    2 Auto-complete Auto-complete 5 email addresses against a 200 card local address book . . . . . . . .
    3 Address Message to 10 Recipients Address an email message to 10 recipients: type in first email address, press return, type in second email address, ... . . . . . . . .
    4 Add 2 Attachments Add 2 100-Kb attachments to a message .
    3.57
    7.36
    0.099
    8.174
    0.439
    8.816
    0.208
    5 Compose HTML Message After addressing message and entering subject line, tab into message body and:
    • Bold some text 
    • Insert a link 
    • Insert a GIF image 
    • Add a bulleted list 
    • Indent a paragraph 
    • Center a paragraph 
    • Select and delete some text
    Note: must use exactly the same text, images and formatting across tests
    2.1
    1.20
    5.298
    0.096
    5.112
    0.103
    5.576
    0.147
    6 Send Message (No Attachment) Send a 10 Kb HTML formatted email message
    1.15
    1.07
    3.134
    0.067
    3.324
    0.223
    3.682
    0.075
    7 Send Message With Attachment Send a 10 Kb HTML formatted email message with a 100 Kb attachment .
    3.86
    5.052
    0.132
    5.098
    0.158
    5.478
    0.169


    Table initially created by Sol Goldfarb
    Timings updated by Suresh Kasinathan
Copyright © 1998-2000 The Mozilla Organization.
Last modified February 24, 2000.