reduce-variance-in-nodes-base-benchmarks - Branch - n8n-io/n8n

Blog Docs

perf: Reduce variance in `nodes-base` benchmarks(#9363)

Merged

Comparing

reduce-variance-in-nodes-base-benchmarks

(

abada87

) with

benchmark-nodes-base-v2

(

f581e40

)

-88%

IMPROVEMENTS: 63

REGRESSIONS: 5

UNTOUCHED: 25

NEW: 0

DROPPED: 0

IGNORED: 0

Benchmarks

Failed

nodes/Aws/S3/test/V2/AwsS3.file.upload.V2.workflowRegression

packages/nodes-base/dist/test/benchmark.js::nodes/Aws/S3/test/V2/AwsS3.file.upload.V2.workflow

-31%

9.6 ms

13.9 ms

nodes/Discord/test/v2/node/channel/get.workflowRegression

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/channel/get.workflow

-88%

13.5 ms

115.1 ms

nodes/Microsoft/Outlook/test/v2/node/calendar/update.workflowRegression

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/calendar/update.workflow

-13%

21.4 ms

24.5 ms

nodes/Microsoft/Teams/test/v2/node/chatMessage/get.workflowRegression

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/chatMessage/get.workflow

-50%

2.2 ms

4.4 ms

nodes/Switch/V3/test/switch.expression.workflowRegression

packages/nodes-base/dist/test/benchmark.js::nodes/Switch/V3/test/switch.expression.workflow

-32%

11.3 ms

16.5 ms

Improved

nodes/Discord/test/v2/node/message/send.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/message/send.workflow

×7.3

70.4 ms

9.7 ms

nodes/WriteBinaryFile/test/WriteBinaryFile.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/WriteBinaryFile/test/WriteBinaryFile.workflow

×5.7

6.2 ms

1.1 ms

nodes/MySql/test/v1/executeQuery.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/MySql/test/v1/executeQuery.workflow

×3.1

8.9 ms

2.9 ms

nodes/Microsoft/Excel/test/v2/node/worksheet/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/worksheet/getAll.workflow

×2.5

6.2 ms

2.5 ms

nodes/Microsoft/Excel/test/v2/node/workbook/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/workbook/getAll.workflow

×2.5

5.6 ms

2.2 ms

nodes/Microsoft/Excel/test/v2/node/worksheet/update.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/worksheet/update.workflow

×2.2

9.3 ms

4.3 ms

nodes/Switch/V1/test/switch.rules.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Switch/V1/test/switch.rules.workflow

×2.1

10.6 ms

5.1 ms

nodes/MoveBinaryData/test/MoveBinaryData.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/MoveBinaryData/test/MoveBinaryData.workflow

+97%

3.3 ms

1.7 ms

nodes/Microsoft/Excel/test/v2/node/worksheet/readRows.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/worksheet/readRows.workflow

+94%

6.4 ms

3.3 ms

nodes/Microsoft/Excel/test/v2/node/worksheet/append.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/worksheet/append.workflow

+79%

7.5 ms

4.2 ms

nodes/Microsoft/Excel/test/v2/node/table/addTable.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/table/addTable.workflow

+74%

4.1 ms

2.4 ms

nodes/Switch/V3/test/switch.regex.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Switch/V3/test/switch.regex.workflow

+72%

11.7 ms

6.8 ms

nodes/Microsoft/Excel/test/v2/node/table/convertToRange.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/table/convertToRange.workflow

+64%

3.9 ms

2.4 ms

nodes/Microsoft/Excel/test/v2/node/table/deleteTable.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/table/deleteTable.workflow

+63%

3.9 ms

2.4 ms

nodes/Microsoft/Teams/test/v2/node/channel/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/channel/getAll.workflow

+63%

2.3 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/task/update.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/task/update.workflow

+62%

2.2 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/channel/create.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/channel/create.workflow

+62%

2.2 ms

1.4 ms

nodes/Microsoft/Excel/test/v2/node/workbook/addWorksheet.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/workbook/addWorksheet.workflow

+61%

3.6 ms

2.3 ms

nodes/Microsoft/Excel/test/v2/node/table/getColumns.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/table/getColumns.workflow

+61%

4 ms

2.5 ms

nodes/Microsoft/Excel/test/v2/node/table/getRows.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/table/getRows.workflow

+61%

4.2 ms

2.6 ms

nodes/Microsoft/Excel/test/v2/node/worksheet/deleteWorksheet.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/worksheet/deleteWorksheet.workflow

+61%

3.9 ms

2.4 ms

nodes/Microsoft/Teams/test/v2/node/channel/update.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/channel/update.workflow

+61%

2.2 ms

1.4 ms

nodes/Microsoft/Excel/test/v2/node/worksheet/clear.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/worksheet/clear.workflow

+61%

4 ms

2.5 ms

nodes/Microsoft/Teams/test/v2/node/task/create.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/task/create.workflow

+61%

2.3 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/channelMessage/create.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/channelMessage/create.workflow

+61%

2.2 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/chatMessage/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/chatMessage/getAll.workflow

+60%

2.2 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/channel/get.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/channel/get.workflow

+60%

2.2 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/channel/deleteChannel.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/channel/deleteChannel.workflow

+60%

2.2 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/task/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/task/getAll.workflow

+60%

2.2 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/task/deleteTask.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/task/deleteTask.workflow

+60%

2.2 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/chatMessage/create.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/chatMessage/create.workflow

+60%

2.2 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/channelMessage/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/channelMessage/getAll.workflow

+59%

2.2 ms

1.4 ms

nodes/Microsoft/Teams/test/v2/node/task/get.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Teams/test/v2/node/task/get.workflow

+59%

2.2 ms

1.4 ms

nodes/Microsoft/Excel/test/v2/node/workbook/deleteWorkbook.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/workbook/deleteWorkbook.workflow

+58%

3.7 ms

2.3 ms

nodes/Microsoft/Excel/test/v2/node/table/lookup.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/table/lookup.workflow

+58%

4.2 ms

2.6 ms

nodes/Discord/test/v2/node/message/react.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/message/react.workflow

+40%

12.8 ms

9.2 ms

nodes/Crypto/test/CryptoTest.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Crypto/test/CryptoTest.workflow

+32%

8.7 ms

6.6 ms

nodes/Discord/test/v2/node/webhook/sendLegacy.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/webhook/sendLegacy.workflow

+28%

4.9 ms

3.8 ms

nodes/Switch/V3/test/switch.rules.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Switch/V3/test/switch.rules.workflow

+26%

24 ms

19 ms

nodes/Microsoft/Outlook/test/v2/node/folderMessage/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/folderMessage/getAll.workflow

+23%

24.6 ms

19.9 ms

nodes/Microsoft/Excel/test/v2/node/table/append.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/table/append.workflow

+22%

6.9 ms

5.7 ms

nodes/Microsoft/Outlook/test/v2/node/calendar/delete.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/calendar/delete.workflow

+21%

23.5 ms

19.4 ms

nodes/Google/BigQuery/test/v2/node/insert.manualMode.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Google/BigQuery/test/v2/node/insert.manualMode.workflow

+21%

1.8 ms

1.5 ms

nodes/Google/BigQuery/test/v2/node/executeQuery.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Google/BigQuery/test/v2/node/executeQuery.workflow

+20%

1.7 ms

1.4 ms

nodes/Files/ConvertToFile/test/toText.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Files/ConvertToFile/test/toText.workflow

+19%

10.7 ms

8.9 ms

nodes/Files/ReadWriteFile/test/ReadWriteFile.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Files/ReadWriteFile/test/ReadWriteFile.workflow

+19%

1.4 ms

1.2 ms

nodes/Switch/V1/test/switch.expression.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Switch/V1/test/switch.expression.workflow

+18%

5.2 ms

4.4 ms

nodes/Microsoft/Excel/test/v2/node/worksheet/upsert.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Excel/test/v2/node/worksheet/upsert.workflow

+17%

8 ms

6.8 ms

nodes/Wait/test/Wait.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Wait/test/Wait.workflow

+16%

5.5 ms

4.8 ms

nodes/Jwt/test/jwt.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Jwt/test/jwt.workflow

+15%

21.8 ms

19 ms

nodes/Aws/S3/test/V1/AwsS3.file.upload.V1.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Aws/S3/test/V1/AwsS3.file.upload.V1.workflow

+14%

9.6 ms

8.4 ms

nodes/RenameKeys/test/RenameKeys.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/RenameKeys/test/RenameKeys.workflow

+12%

4.5 ms

4.1 ms

nodes/Microsoft/Outlook/test/v2/node/contact/update.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/contact/update.workflow

+11%

21.8 ms

19.6 ms

nodes/Discord/test/v2/node/message/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/message/getAll.workflow

+11%

10.2 ms

9.2 ms

nodes/Microsoft/Outlook/test/v2/node/contact/create.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/contact/create.workflow

+11%

21.6 ms

19.4 ms

nodes/Microsoft/Outlook/test/v2/node/event/create.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/event/create.workflow

+11%

21.8 ms

19.7 ms

nodes/Discord/test/v2/node/message/deleteMessage.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/message/deleteMessage.workflow

+11%

10.1 ms

9.1 ms

nodes/Discord/test/v2/node/message/get.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/message/get.workflow

+11%

10.2 ms

9.2 ms

nodes/Discord/test/v2/node/channel/update.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/channel/update.workflow

+10%

10.3 ms

9.3 ms

nodes/Discord/test/v2/node/member/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/member/getAll.workflow

+10%

10.2 ms

9.3 ms

nodes/Microsoft/Outlook/test/v2/node/draft/create.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/draft/create.workflow

+10%

21.6 ms

19.5 ms

nodes/Set/test/Set.v3_3.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Set/test/Set.v3_3.workflow

+10%

51.7 ms

46.9 ms

nodes/Discord/test/v2/node/channel/create.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/channel/create.workflow

+10%

10.1 ms

9.2 ms

Passed

nodes/Microsoft/Outlook/test/v2/node/message/reply.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/message/reply.workflow

+10%

21.8 ms

19.8 ms

nodes/Discord/test/v2/node/channel/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/channel/getAll.workflow

+10%

10 ms

9.1 ms

nodes/Microsoft/Outlook/test/v2/node/message/send.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/message/send.workflow

+10%

21.5 ms

19.6 ms

nodes/Microsoft/Outlook/test/v2/node/calendar/getAll.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/calendar/getAll.workflow

+10%

21.4 ms

19.5 ms

nodes/Discord/test/v2/node/member/roleAdd.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/member/roleAdd.workflow

+10%

10 ms

9.1 ms

nodes/Discord/test/v2/node/member/roleRemove.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/member/roleRemove.workflow

+10%

10 ms

9.2 ms

nodes/Microsoft/Outlook/test/v2/node/message/move.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/message/move.workflow

+10%

21.6 ms

19.7 ms

nodes/Discord/test/v2/node/channel/deleteChannel.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Discord/test/v2/node/channel/deleteChannel.workflow

+10%

10 ms

9.1 ms

nodes/Microsoft/Outlook/test/v2/node/calendar/get.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/calendar/get.workflow

+10%

21.3 ms

19.5 ms

nodes/Microsoft/Outlook/test/v2/node/calendar/create.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/calendar/create.workflow

+10%

21.3 ms

19.4 ms

nodes/Microsoft/Outlook/test/v2/node/folder/create.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/folder/create.workflow

+9%

21.4 ms

19.5 ms

nodes/Code/test/Code.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Code/test/Code.workflow

+8%

52.1 ms

48.4 ms

nodes/ReadPdf/test/ReadPDF-encrypted.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/ReadPdf/test/ReadPDF-encrypted.workflow

+7%

1.2 ms

1.1 ms

nodes/ReadPdf/test/ReadPDF.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/ReadPdf/test/ReadPDF.workflow

+6%

1.2 ms

1.1 ms

nodes/Set/test/Set.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Set/test/Set.workflow

+6%

10.5 ms

9.9 ms

nodes/Set/test/Set.v3.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Set/test/Set.v3.workflow

+6%

58.5 ms

55.4 ms

nodes/Google/BigQuery/test/v2/node/insert.autoMapMode.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Google/BigQuery/test/v2/node/insert.autoMapMode.workflow

+5%

9.1 ms

8.7 ms

nodes/Switch/V2/test/switch.rules.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Switch/V2/test/switch.rules.workflow

+4%

12.2 ms

11.7 ms

nodes/ReadBinaryFiles/test/ReadBinaryFiles.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/ReadBinaryFiles/test/ReadBinaryFiles.workflow

+3%

1.2 ms

1.1 ms

nodes/Html/test/extractHtmlContent.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Html/test/extractHtmlContent.workflow

+3%

57.4 ms

55.8 ms

nodes/ReadBinaryFile/test/ReadBinaryFile.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/ReadBinaryFile/test/ReadBinaryFile.workflow

+3%

1.1 ms

nodes/QuickChart/test/QuickChart.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/QuickChart/test/QuickChart.workflow

+3%

32.2 ms

31.5 ms

nodes/Switch/V2/test/switch.expression.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Switch/V2/test/switch.expression.workflow

11.4 ms

11.3 ms

nodes/Microsoft/Outlook/test/v2/node/draft/send.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Microsoft/Outlook/test/v2/node/draft/send.workflow

-6%

21.4 ms

22.8 ms

nodes/Files/test/convert_extract.workflow

packages/nodes-base/dist/test/benchmark.js::nodes/Files/test/convert_extract.workflow

-9%

11.7 ms

12.8 ms

Commits

Click on a commit to change the comparison range

base

benchmark-nodes-base-v2

f581e40

-88%

perf: Reduce variance in `nodes-base` benchmarks

abada87

5 months ago

by ivov

ResourcesHome Pricing Docs Blog GitHub Changelog

Getting StartedSample repository Explore repositories Support

AboutCareers Twitter Discord Contact Us Terms of Service Privacy Policy