Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • For pages with no requirements, we've improved the speed by skipping our indexation:
    • We skip the parsing if the storage format hasn't changed,
    • We skip the parsing if the rendered format hasn't changed, in case it contains an "Include" or "Scaffolding" macro.
    • We skip the parsing if there is no requirement in the old or new version.
  • For pages with requirements:
    • We've added indexes on database columns. On our instance we get 5x faster results when saving a page, but we may be in special circumstances.
    • When we index a page (=when a user saves a page), we've batched the lookups of requirements, so we don't do 1 database request for each requirement on the page. On our instance, we get again 4x faster times depending on database latency (most LANs are on 1ms latency, but we've measured with 5ms).
    • We'd be thrilled if you have 20x better response times than in 1.11.4, but we'll check back with customers before asserting that.

Performance change in 2.0

  • We've deeply modified the indexing algorithm in 2.0, because we are now importing Excel files.
  • This algo generally reads first and checks whether it needs to change the data, instead of deleting all and writing blindly.
  • We did not notice much change in speed. Some speeds are improved, other are worse, depending on the number of modified requirements and properties.

Details

We have evaluated on a personal machine with the following setup:

...

Event

Time (in addition to Confluence's algorithm).

For ~400 requirements, ~525Kb text per page, 2ms network latency. No Jira connection.

Time

1ms latency,
1000 requirements

Page creation
  • 480ms rendering of the page
  • 22ms per requirement,
  • Total: +8.9 seconds (on top of Confluence's algorithm).
  • 1082ms
    rendering (Confluence)
  • 13ms per requirement
  • Total +13s
Page edition
  • 700ms rendering of the page
  • 21ms per requirement,
  • Total +11.6 seconds.
  • 1700ms rendering
  • 15ms per requirement
  • Total +15.7s

Submission of excerpts

(This operation is in the background, the user doesn't wait for this).

  • 20-40ms per modified requirement
    (depending on the size of text and the number of properties).
  • Total 18,7s for 400 modified requirements.
  • Note: This is with 2ms additional network latency per DB queries. For most networks between a server and its database, the latency is sub-1ms.
  • 8ms per modified requirement.
  • Total +8111ms

New result:

  • 3ms per modified requirement
  • Total: 3s
60ms par requirement, c'est 60 requêtes. 
Tested for Requirement Yogi 2.0.0 with 2ms and 1ms network latency, in addition to the database latency, already loaded with 80.000 requirements.

...