CR v2 Beta -- Fedora Test Results
Attached below is a brief summary of our test results for CR v2 BETA.
Build artifacts ::
- Minimal :: https://ci.cloudrouter.org/job/cloudrouter-image-builder-via-ks/91/ and https://ci.cloudrouter.org/job/cloudrouter-image-builder-via-ks/98/ and https://ci.cloudrouter.org/job/cloudrouter-image-builder-via-ks/101/
- Full:: https://ci.cloudrouter.org/job/cloudrouter-image-builder-via-ks/93/ and https://ci.cloudrouter.org/job/cloudrouter-image-builder-via-ks/97/ and https://ci.cloudrouter.org/job/cloudrouter-image-builder-via-ks/108/
- DVD ISO: https://ci.cloudrouter.org/job/cloudrouter-image-builder-via-ks/118/
- LIVE ISO: https://ci.cloudrouter.org/job/cloudrouter-image-builder-via-ks/122/
CR repo url :: https://repo.cloudrouter.org/fedora/2/x86_64/
| Test Description | Test Result (PASS/FAIL) | Issues/Comments | |
|---|---|---|---|
| 1 | check for -beta tags on builds,images. | PASS | CR-99 - Getting issue details... STATUS |
| 2 | test install minimal build on virt-manager(fedora 22). verify cloud-init works | PASS | our cloud-init instructions are outdated. needs to be updated. |
| 3 | test install minimal build on GCE verify cloud-init works | PASS | |
| 4 | test install full build on GCE verify cloud-init works | PASS | |
| 5 | test install full build on virt-manager(fedora 22) verify cloud-init works | PASS | |
| 6 | Run automated tests for ODL lithium | PASS | Full - https://ci.cloudrouter.org/job/ODL-Stable-Tests/14/robot/report/report.html Minimal - https://ci.cloudrouter.org/job/ODL-Stable-Tests/15/robot/report/report.html |
| 7 | Run automated tests for ONOS cardinal | PASS | Full - https://ci.cloudrouter.org/job/ONOS-Stable-Tests/20/robot/report/report.html Minimal -https://ci.cloudrouter.org/job/ONOS-Stable-Tests/21/robot/report/report.html |
| 8 | Sanity check mininet package | PASS | bug CR-96 - Getting issue details... STATUS sanity test results - http://pastebin.com/raw.php?i=3hRHTVDC sanity test results full - http://pastebin.com/raw.php?i=DvsrERmj
|
| 9 | Sanity check fastnetmon package | PASS | bug CR-97 - Getting issue details... STATUS result output :: http://pastebin.com/raw.php?i=tkii9CcH Generated sample data for fastnetmon with nping – http://pastebin.com/raw.php?i=rTbxb6TC Sanity check plan kept here now – Fastnetmon - Sanity check |
| 10 | Sanity check capstan package | PASS | https://gist.githubusercontent.com/ckannan/c2724b89091d33949f3c/raw/126d212249995076b9a1a0b8437d5030d46538cd/gistfile1.txt |
| 11 | Run automated virt-tests | PASS | current tests upgraded, will checking to github after tagging repo. all new tests passed on signed packages from (7/7/15)
retested on Build #98 and 101, 108 and still working dnf update test added and 101 and 108 tested with this new test |
| 12 | Run automated bird core tests | PASS | need to add dnf install traceroute to install script |
| 13 | Targeted issues and enhancements | ON-GOING | See list here: CR-2 |
| 14 | Security review | PASS | Manual testing by David Jorm revealed no known vulnerabilities, and no default credentials |
| 15 | Test and verify - LiveCD, DVD ISO files | PASS | live cd boots up correctly. and all the packages for CR are present. cloudrouter repo is available and branding is correct for beta. DVD ISO boots up on virt-manager, prompts the user to set 'root' password and then proceeds with the install. CR full package set and repo are available. |