Most Powerful Open Source ERP

ERP5 Unit Tests

This page provides information how to download ERP5's source code.
  • Last Update:2015-11-18
  • Version:001
  • Language:en

Introduction

ERP5 is used for many critical applications. Our customers relies on it to run their every day business, and they can not accept having regularly bugs coming again and again. Every software issue could have important consequences, especially if you think about banking, areospace applications and many others. Therefore Nexedi consider the quality as one of it's top priorities and decided to use automated testing since the early age of ERP5.

Unit / Functional Test

While the code of ERP5 is evolving, more and more unit and functional tests are added. When issues are reported, we write the test and fix the problem. Like this we make sure that the same issue is not going to happens again. Also, when new features are done, tests are added to make sure we will provide well working experience. We have both unit test and functional tests. Unit test are used to test isolated software component, while functional tests are used to verify scenarios more closed to user experience.

Development policy

We tried for years to keep the quantity of failures as low as possible. While the size of ERP5 was growing, it started to be more and more time consuming to track regressions. In particular, it's quite common that a change in some part of the code generate a regression in another place that seems unrelated without detailed analysis. And then it happened that we had several errors, and it was difficult to see new ones. Therefore, after our switch to git, we introduced the rule "contributions must not introduce ANY regression". So we started by fixing test failures, we checked all random issues, and we started to reject any code introducing failures. The idea is simply to check all unit test before contributing changes to the central place. This can easily be done thanks to our Testing Infrastructure. Thanks to this rule, about any revision of ERP5 could be considered as stable. This is really a great success. With a quantity of test growing, we have nearly 0 errors/failures all the time.

Testing Infracture

We are using what we call "ERP5 Test Nodes". It's some processes installed on many different machines thanks to SlapOS cloud tools. We define several list of tests to run, and ERP5 test nodes will look regularly to several git repositories to detect new commit, then they launch software constructions and finally tests are automatically run. Theses days we are using about 60 CPU cores to run tests for our various projects and for different versions.

ERP5 Test Results

You can find below the result of automatic test of ERP5 code. Hopefully you are able to see many test results at 0 errors/failures for several thousands of tests. Since we are humans and not perfect, It might happens that a change introduce a regression. But in this case, you could be sure that we will quickly look and solve it.

1 - 15 of sample of 1000 records
Revision Launch Date Title All Tests Failures Errors Skips Result Status
slapos.cookbook=11817-f05b5b816c4946108a18afdfe95938f787a39ee3,erp5=50699-3d8f2a5aacccd4058ca3870176c2938c25826764,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/11/07 03:17:13.407033 UTC ERP5-MASTER 6158 0 0 201 PASS Completed
slapos.cookbook=11817-f05b5b816c4946108a18afdfe95938f787a39ee3,erp5=50694-a41f71c3953af5fe18b5d2494c6122d47dfab289,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/11/06 20:21:43.562192 UTC ERP5-MASTER 6158 3 0 201 FAIL Completed
slapos.cookbook=11816-bff74b2e5f4ebdfed51dddfae5350fdeb375a613,erp5=50694-a41f71c3953af5fe18b5d2494c6122d47dfab289,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/11/06 15:45:9.382965 UTC ERP5-MASTER 6152 1 1 201 FAIL Completed
slapos.cookbook=11814-0f5b52f26636981a318861276d3af80aac1efd7e,erp5=50694-a41f71c3953af5fe18b5d2494c6122d47dfab289,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/11/06 11:46:32.347280 UTC ERP5-MASTER 6158 5 0 201 FAIL Completed
slapos.cookbook=11806-b4bff336d0bfb6763a4789dce3cb976653bfe1e8,erp5=50692-3a7831527ad9aad472d0896e9bb921ad0f1103af,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/11/06 08:02:23.672934 UTC ERP5-MASTER 6158 3 0 201 FAIL Completed
slapos.cookbook=11805-f0f32aaac24c3d7a8b132caf672d1455b3530f4f,erp5=50692-3a7831527ad9aad472d0896e9bb921ad0f1103af,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/11/06 03:36:59.971387 UTC ERP5-MASTER 6158 1 0 201 FAIL Completed
slapos.cookbook=11805-f0f32aaac24c3d7a8b132caf672d1455b3530f4f,erp5=50691-ffa68e48094eb136ea99d4f63d6deaf9e2d7107f,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/11/05 17:59:35.612065 UTC ERP5-MASTER 6158 2 0 201 FAIL Completed
slapos.cookbook=11804-51ff6884788485edec9a4d8232ebd8ec229dfeef,erp5=50690-58144924b75d66e33218e393246039fb3c42a827,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/11/05 09:38:42.613759 UTC ERP5-MASTER 6158 1 0 201 FAIL Completed
slapos.cookbook=11803-9b9adb879d58a1ddce2f6916261f5831cc196cb0,erp5=50690-58144924b75d66e33218e393246039fb3c42a827,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/11/04 16:26:42.990938 UTC ERP5-MASTER 6158 4 0 201 FAIL Completed
slapos.cookbook=11802-de29810454e9a1f4bc68386a15f52b2809ea0aca,erp5=50690-58144924b75d66e33218e393246039fb3c42a827,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/10/31 23:25:43.265459 UTC ERP5-MASTER 6158 2 0 201 FAIL Completed
slapos.cookbook=11802-de29810454e9a1f4bc68386a15f52b2809ea0aca,erp5=50688-c7a292ba113897219fe555f212de5dc7f4355e5f,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/10/31 18:45:2.377776 UTC ERP5-MASTER 6158 2 0 201 FAIL Completed
slapos.cookbook=11800-ba6520780745649ead4bf244ead8e7fcd6bdc912,erp5=50686-cd18daf41128ac5ba69dafd62fbc72b43103f680,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/10/31 16:38:38.005147 UTC ERP5-MASTER 6156 5 0 201 FAIL Completed
slapos.cookbook=11800-ba6520780745649ead4bf244ead8e7fcd6bdc912,erp5=50685-5d86b98b62eff8fb41407f2fb2fe89e18f86586f,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/10/31 14:33:17.952248 UTC ERP5-MASTER 6156 5 0 201 FAIL Completed
slapos.cookbook=11800-ba6520780745649ead4bf244ead8e7fcd6bdc912,erp5=50669-cddfab91a24ee26b411b7369665298b5bb8252d6,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/10/31 12:03:36.438794 UTC ERP5-MASTER 6147 3 0 201 FAIL Completed
slapos.cookbook=11799-5616562fd802145f783e3dacf694092357113868,erp5=50662-954f86ccbe1fcbeae6cbadfa8a85f7ab4ff678a2,erp5-bin=15-d6943bfe7148ff18744e8d848997c234e34fb09a,erp5-doc=5-6cb6bb594beac5b55ed756d983d92d0a18792269 2019/10/31 07:27:43.419146 UTC ERP5-MASTER 6141 2 0 201 FAIL Completed