2024-02-22 11:04:13.082951 DigProc: Starting 2024-02-22 11:04:13.083089 DigProc: Configuring mirroring sessions... 2024-02-22 11:04:13.083165 DigProc: Setting up multicast 1, egress port:3, redundancy:1 2024-02-22 11:04:13.083229 DigProc: Adding multicast nodes... 2024-02-22 11:04:13.083286 DigProc: Creating node 1 2024-02-22 11:21:17.356589 DigProc: Starting 2024-02-22 11:21:17.356731 DigProc: Configuring mirroring sessions... 2024-02-22 11:21:17.356818 DigProc: Setting up multicast 1, egress port:3, redundancy:1 2024-02-22 11:21:17.356886 DigProc: Adding multicast nodes... 2024-02-22 11:21:17.356955 DigProc: Creating node 1 2024-02-22 11:21:24.980153 DigProc: Starting 2024-02-22 11:21:24.980283 DigProc: Configuring mirroring sessions... 2024-02-22 11:21:24.980366 DigProc: Setting up multicast 1, egress port:3, redundancy:1 2024-02-22 11:21:24.980436 DigProc: Adding multicast nodes... 2024-02-22 11:21:24.980506 DigProc: Creating node 1 2024-02-22 11:48:18.655489 DigProc: Starting 2024-02-22 11:48:18.655601 DigProc: Populating the P4 tables... 2024-02-22 11:48:18.655671 DigProc: Inserting forwarding rules... 2024-02-22 11:48:18.655809 DigProc: 192.168.1.91->64 2024-02-22 12:09:16.332419 DigProc: Starting 2024-02-22 12:09:16.332549 DigProc: Populating the P4 tables... 2024-02-22 12:09:16.332639 DigProc: Inserting forwarding rules... 2024-02-22 12:09:16.332802 DigProc: 192.168.1.91->64 2024-02-22 12:16:54.067753 DigProc: Starting 2024-02-22 12:16:54.067868 DigProc: Populating the P4 tables... 2024-02-22 12:16:54.067934 DigProc: Inserting forwarding rules... 2024-02-22 12:16:54.068060 DigProc: 192.168.1.91->64 2024-02-22 12:26:14.020314 DigProc: Starting 2024-02-22 12:26:14.020431 DigProc: Populating the P4 tables... 2024-02-22 12:26:14.020498 DigProc: Inserting forwarding rules... 2024-02-22 12:26:14.020609 DigProc: 192.168.1.91->64 2024-02-22 12:27:32.267278 DigProc: Starting 2024-02-22 12:27:32.267390 DigProc: Populating the P4 tables... 2024-02-22 12:27:32.267452 DigProc: Inserting forwarding rules... 2024-02-22 12:27:32.267554 DigProc: 192.168.1.91->64 2024-02-22 13:23:43.935375 DigProc: Starting 2024-02-22 13:23:43.935486 DigProc: Populating the P4 tables... 2024-02-22 13:23:43.935555 DigProc: Inserting forwarding rules... 2024-02-22 13:23:43.935674 DigProc: 192.168.1.91->64 2024-02-22 13:25:54.796017 DigProc: Starting 2024-02-22 13:25:54.796130 DigProc: Populating the P4 tables... 2024-02-22 13:25:54.796195 DigProc: Inserting forwarding rules... 2024-02-22 13:25:54.796305 DigProc: 192.168.1.91->64 2024-02-22 13:26:49.000341 DigProc: Starting 2024-02-22 13:26:49.000456 DigProc: Populating the P4 tables... 2024-02-22 13:26:49.000534 DigProc: Inserting forwarding rules... 2024-02-22 13:26:49.000647 DigProc: 192.168.1.91->64 2024-02-22 13:26:49.001081 DigProc: 192.168.1.86->3 2024-02-22 13:26:49.001308 DigProc: 192.168.1.87->7 2024-02-22 13:26:49.001481 DigProc: Inserting KeyWrite rules... 2024-02-22 13:26:49.001588 DigProc: 192.168.1.87,7,1 2024-02-22 13:26:49.001655 DigProc: {'mgid': 9, 'redundancy': 1, 'egressPort': 7} 2024-02-22 13:26:49.001738 DigProc: Adding multiwrite rule 192.168.1.87,N=1 - 9 2024-02-22 13:27:40.093491 DigProc: Starting 2024-02-22 13:27:40.093604 DigProc: Populating the P4 tables... 2024-02-22 13:27:40.093682 DigProc: Inserting forwarding rules... 2024-02-22 13:27:40.093813 DigProc: 192.168.1.91->64 2024-02-22 13:28:18.147528 DigProc: Starting 2024-02-22 13:28:18.147642 DigProc: Populating the P4 tables... 2024-02-22 13:28:18.147713 DigProc: Inserting forwarding rules... 2024-02-22 13:28:18.147815 DigProc: 192.168.1.91->64 2024-02-22 13:28:18.148185 DigProc: 192.168.1.86->3 2024-02-22 13:28:18.148387 DigProc: 192.168.1.87->7 2024-02-22 13:28:18.148557 DigProc: Inserting KeyWrite rules... 2024-02-22 13:28:18.148644 DigProc: 192.168.1.87,7,1 2024-02-22 13:28:18.148712 DigProc: {'mgid': 9, 'redundancy': 1, 'egressPort': 7} 2024-02-22 13:28:18.148765 DigProc: Adding multiwrite rule 192.168.1.87,N=1 - 9 2024-02-22 13:34:01.046623 DigProc: Starting 2024-02-22 13:34:01.046739 DigProc: Configuring mirroring sessions... 2024-02-22 13:34:01.046799 DigProc: Setting up multicast 1, egress port:3, redundancy:1 2024-02-22 13:34:01.046846 DigProc: Adding multicast nodes... 2024-02-22 13:34:01.046904 DigProc: Creating node 1 2024-02-22 13:34:53.222689 DigProc: Starting 2024-02-22 13:34:53.222804 DigProc: Configuring mirroring sessions... 2024-02-22 13:34:53.222879 DigProc: Setting up multicast 1, egress port:3, redundancy:1 2024-02-22 13:34:53.222933 DigProc: Adding multicast nodes... 2024-02-22 13:34:53.222981 DigProc: Creating node 1 2024-02-22 13:34:53.223313 DigProc: Creating the multicast group 2024-02-22 13:34:53.223821 DigProc: Setting up multicast 2, egress port:3, redundancy:2 2024-02-22 13:34:53.223898 DigProc: Adding multicast nodes... 2024-02-22 13:34:53.223955 DigProc: Creating node 2 2024-02-22 13:34:53.224144 DigProc: Creating node 3 2024-02-22 13:34:53.224340 DigProc: Creating the multicast group 2024-02-22 13:34:53.224881 DigProc: Setting up multicast 3, egress port:3, redundancy:3 2024-02-22 13:34:53.224965 DigProc: Adding multicast nodes... 2024-02-22 13:34:53.225025 DigProc: Creating node 4 2024-02-22 13:34:53.225189 DigProc: Creating node 5 2024-02-22 13:34:53.225391 DigProc: Creating node 6 2024-02-22 13:34:53.225554 DigProc: Creating the multicast group 2024-02-22 13:34:53.226241 DigProc: Setting up multicast 4, egress port:3, redundancy:4 2024-02-22 13:34:53.226317 DigProc: Adding multicast nodes... 2024-02-22 13:34:53.226371 DigProc: Creating node 7 2024-02-22 13:34:53.226553 DigProc: Creating node 8 2024-02-22 13:34:53.226764 DigProc: Creating node 9 2024-02-22 13:34:53.226925 DigProc: Creating node 10 2024-02-22 13:34:53.227096 DigProc: Creating the multicast group 2024-02-22 13:39:26.337460 DigProc: Starting 2024-02-22 13:39:26.337574 DigProc: Configuring mirroring sessions... 2024-02-22 13:39:26.337654 DigProc: Setting up multicast 1, egress port:3, redundancy:1 2024-02-22 13:39:26.337722 DigProc: Adding multicast nodes... 2024-02-22 13:39:26.337783 DigProc: Creating node 1 2024-02-22 13:39:26.338168 DigProc: Creating the multicast group 2024-02-22 13:39:26.338627 DigProc: Setting up multicast 2, egress port:3, redundancy:2 2024-02-22 13:39:26.338736 DigProc: Adding multicast nodes... 2024-02-22 13:39:26.338819 DigProc: Creating node 2 2024-02-22 13:39:26.339075 DigProc: Creating node 3 2024-02-22 13:39:26.339318 DigProc: Creating the multicast group 2024-02-22 13:39:26.340019 DigProc: Setting up multicast 3, egress port:3, redundancy:3 2024-02-22 13:39:26.340120 DigProc: Adding multicast nodes... 2024-02-22 13:39:26.340210 DigProc: Creating node 4 2024-02-22 13:39:26.340469 DigProc: Creating node 5 2024-02-22 13:39:26.340729 DigProc: Creating node 6 2024-02-22 13:39:26.340980 DigProc: Creating the multicast group 2024-02-22 13:39:26.341832 DigProc: Setting up multicast 4, egress port:3, redundancy:4 2024-02-22 13:39:26.341931 DigProc: Adding multicast nodes... 2024-02-22 13:39:26.342013 DigProc: Creating node 7 2024-02-22 13:39:26.342270 DigProc: Creating node 8 2024-02-22 13:39:26.342527 DigProc: Creating node 9 2024-02-22 13:39:26.342787 DigProc: Creating node 10 2024-02-22 13:39:26.343040 DigProc: Creating the multicast group 2024-02-22 13:41:43.143848 DigProc: Starting 2024-02-22 13:41:43.143965 DigProc: Configuring mirroring sessions... 2024-02-22 13:41:43.144056 DigProc: Setting up multicast 0, egress port:3, redundancy:1 2024-02-22 13:41:43.144124 DigProc: Adding multicast nodes... 2024-02-22 13:41:43.144201 DigProc: Creating node 1 2024-02-22 13:41:43.144615 DigProc: Creating the multicast group 2024-02-22 13:41:43.145153 DigProc: Setting up multicast 1, egress port:3, redundancy:2 2024-02-22 13:41:43.145247 DigProc: Adding multicast nodes... 2024-02-22 13:41:43.145333 DigProc: Creating node 2 2024-02-22 13:41:43.145546 DigProc: Creating node 3 2024-02-22 13:41:43.145792 DigProc: Creating the multicast group 2024-02-22 13:41:43.146368 DigProc: Setting up multicast 2, egress port:3, redundancy:3 2024-02-22 13:41:43.146465 DigProc: Adding multicast nodes... 2024-02-22 13:41:43.146558 DigProc: Creating node 4 2024-02-22 13:41:43.146776 DigProc: Creating node 5 2024-02-22 13:41:43.147017 DigProc: Creating node 6 2024-02-22 13:41:43.147270 DigProc: Creating the multicast group 2024-02-22 13:41:43.148226 DigProc: Setting up multicast 3, egress port:3, redundancy:4 2024-02-22 13:41:43.148330 DigProc: Adding multicast nodes... 2024-02-22 13:41:43.148417 DigProc: Creating node 7 2024-02-22 13:41:43.148674 DigProc: Creating node 8 2024-02-22 13:41:43.148888 DigProc: Creating node 9 2024-02-22 13:41:43.149139 DigProc: Creating node 10 2024-02-22 13:41:43.149323 DigProc: Creating the multicast group 2024-02-22 13:41:43.150142 DigProc: Setting up multicast 5, egress port:64, redundancy:1 2024-02-22 13:41:43.150239 DigProc: Adding multicast nodes... 2024-02-22 13:41:43.150311 DigProc: Creating node 11 2024-02-22 13:41:43.150575 DigProc: Creating the multicast group 2024-02-22 13:44:16.638186 DigProc: Starting 2024-02-22 13:44:16.638298 DigProc: Populating the P4 tables... 2024-02-22 13:44:16.638362 DigProc: Inserting forwarding rules... 2024-02-22 13:44:16.638482 DigProc: 192.168.1.91->64 2024-02-22 13:44:16.638884 DigProc: 192.168.1.86->3 2024-02-22 13:44:16.639100 DigProc: 192.168.1.87->7 2024-02-22 13:44:16.639281 DigProc: Inserting KeyWrite rules... 2024-02-22 13:44:16.639373 DigProc: 192.168.1.87,7,1 2024-02-22 13:44:16.639429 DigProc: {'egressPort': 7, 'redundancy': 1, 'mgid': 9} 2024-02-22 13:44:16.639488 DigProc: Adding multiwrite rule 192.168.1.87,N=1 - 9 2024-02-22 13:44:16.639647 DigProc: 192.168.1.87,7,2 2024-02-22 13:44:16.639731 DigProc: {'egressPort': 7, 'redundancy': 2, 'mgid': 10} 2024-02-22 13:44:16.639788 DigProc: Adding multiwrite rule 192.168.1.87,N=2 - 10 2024-02-22 13:44:16.639921 DigProc: 192.168.1.87,7,3 2024-02-22 13:44:16.639996 DigProc: {'egressPort': 7, 'redundancy': 3, 'mgid': 11} 2024-02-22 13:44:16.640055 DigProc: Adding multiwrite rule 192.168.1.87,N=3 - 11 2024-02-22 13:44:16.640179 DigProc: 192.168.1.87,7,4 2024-02-22 13:44:16.640244 DigProc: {'egressPort': 7, 'redundancy': 4, 'mgid': 12} 2024-02-22 13:44:16.640303 DigProc: Adding multiwrite rule 192.168.1.87,N=4 - 12 2024-02-22 13:44:16.640453 DigProc: Inserting RDMA metadata into ASIC... 2024-02-22 13:44:16.640541 DigProc: Setting up a new RDMA connection from virtual client... port 1336 dir /root/wly_experiment/dta_results/rdma_metadata/1336 2024-02-22 13:44:28.244177 DigProc: Reading collector metadata from disk... 2024-02-22 13:44:28.244859 DigProc: !!! !!! Failed to read RDMA metadata !!! !!! 2024-02-22 13:44:28.245051 DigProc: Collector metadata read from disk! 2024-02-22 14:42:03.961299 DigProc: Starting 2024-02-22 14:42:03.961408 DigProc: Populating the P4 tables... 2024-02-22 14:42:03.961465 DigProc: Inserting forwarding rules... 2024-02-22 14:42:03.961569 DigProc: 192.168.1.91->64 2024-02-22 14:42:03.961993 DigProc: 192.168.1.86->3 2024-02-22 14:42:03.962209 DigProc: 192.168.1.87->7 2024-02-22 14:42:03.962395 DigProc: Inserting KeyWrite rules... 2024-02-22 14:42:03.962497 DigProc: 192.168.1.87,7,1 2024-02-22 14:42:03.962562 DigProc: {'egressPort': 7, 'mgid': 9, 'redundancy': 1} 2024-02-22 14:42:03.962627 DigProc: Adding multiwrite rule 192.168.1.87,N=1 - 9 2024-02-22 14:42:03.962819 DigProc: 192.168.1.87,7,2 2024-02-22 14:42:03.962894 DigProc: {'egressPort': 7, 'mgid': 10, 'redundancy': 2} 2024-02-22 14:42:03.962954 DigProc: Adding multiwrite rule 192.168.1.87,N=2 - 10 2024-02-22 14:42:03.963111 DigProc: 192.168.1.87,7,3 2024-02-22 14:42:03.963187 DigProc: {'egressPort': 7, 'mgid': 11, 'redundancy': 3} 2024-02-22 14:42:03.963245 DigProc: Adding multiwrite rule 192.168.1.87,N=3 - 11 2024-02-22 14:42:03.963383 DigProc: 192.168.1.87,7,4 2024-02-22 14:42:03.963468 DigProc: {'egressPort': 7, 'mgid': 12, 'redundancy': 4} 2024-02-22 14:42:03.963536 DigProc: Adding multiwrite rule 192.168.1.87,N=4 - 12 2024-02-22 14:42:03.963690 DigProc: Inserting RDMA metadata into ASIC... 2024-02-22 14:42:03.963774 DigProc: Setting up a new RDMA connection from virtual client... port 1336 dir /root/wly_experiment/dta_results/rdma_metadata/1336 2024-02-22 14:42:15.564067 DigProc: Reading collector metadata from disk... 2024-02-22 14:42:15.564753 DigProc: !!! !!! Failed to read RDMA metadata !!! !!! 2024-02-22 14:42:15.564995 DigProc: Collector metadata read from disk! 2024-02-22 21:10:53.156916 DigProc: Starting 2024-02-22 21:10:53.157026 DigProc: Populating the P4 tables... 2024-02-22 21:10:53.157129 DigProc: Inserting forwarding rules... 2024-02-22 21:10:53.157250 DigProc: 192.168.1.91->64 2024-02-22 21:10:53.157712 DigProc: 192.168.1.86->3 2024-02-22 21:10:53.157980 DigProc: 192.168.1.87->7 2024-02-22 21:10:53.158160 DigProc: Inserting KeyWrite rules... 2024-02-22 21:10:53.158264 DigProc: 192.168.1.87,7,1 2024-02-22 21:10:53.158339 DigProc: {'mgid': 9, 'egressPort': 7, 'redundancy': 1} 2024-02-22 21:10:53.158424 DigProc: Adding multiwrite rule 192.168.1.87,N=1 - 9 2024-02-22 21:10:53.158603 DigProc: 192.168.1.87,7,2 2024-02-22 21:10:53.158706 DigProc: {'mgid': 10, 'egressPort': 7, 'redundancy': 2} 2024-02-22 21:10:53.158762 DigProc: Adding multiwrite rule 192.168.1.87,N=2 - 10 2024-02-22 21:10:53.158897 DigProc: 192.168.1.87,7,3 2024-02-22 21:10:53.158989 DigProc: {'mgid': 11, 'egressPort': 7, 'redundancy': 3} 2024-02-22 21:10:53.159053 DigProc: Adding multiwrite rule 192.168.1.87,N=3 - 11 2024-02-22 21:10:53.159188 DigProc: 192.168.1.87,7,4 2024-02-22 21:10:53.159272 DigProc: {'mgid': 12, 'egressPort': 7, 'redundancy': 4} 2024-02-22 21:10:53.159335 DigProc: Adding multiwrite rule 192.168.1.87,N=4 - 12 2024-02-22 21:10:53.159495 DigProc: Inserting RDMA metadata into ASIC... 2024-02-22 21:10:53.159573 DigProc: Setting up a new RDMA connection from virtual client... port 1336 dir /root/wly_experiment/dta_results/rdma_metadata/1336 2024-02-22 21:11:04.775371 DigProc: Reading collector metadata from disk... 2024-02-22 21:11:04.776094 DigProc: !!! !!! Failed to read RDMA metadata !!! !!! 2024-02-22 21:11:04.776371 DigProc: Collector metadata read from disk! 2024-02-22 21:20:36.578074 DigProc: Starting 2024-02-22 21:20:36.578186 DigProc: Populating the P4 tables... 2024-02-22 21:20:36.578255 DigProc: Inserting forwarding rules... 2024-02-22 21:20:36.578379 DigProc: 192.168.1.91->64 2024-02-22 21:20:36.578788 DigProc: 192.168.1.86->3 2024-02-22 21:20:36.578990 DigProc: 192.168.1.87->7 2024-02-22 21:20:36.579152 DigProc: Inserting KeyWrite rules... 2024-02-22 21:20:36.579243 DigProc: 192.168.1.87,7,1 2024-02-22 21:20:36.579304 DigProc: {'egressPort': 7, 'redundancy': 1, 'mgid': 9} 2024-02-22 21:20:36.579359 DigProc: Adding multiwrite rule 192.168.1.87,N=1 - 9 2024-02-22 21:20:36.579523 DigProc: 192.168.1.87,7,2 2024-02-22 21:20:36.579595 DigProc: {'egressPort': 7, 'redundancy': 2, 'mgid': 10} 2024-02-22 21:20:36.579649 DigProc: Adding multiwrite rule 192.168.1.87,N=2 - 10 2024-02-22 21:20:36.579793 DigProc: 192.168.1.87,7,3 2024-02-22 21:20:36.579860 DigProc: {'egressPort': 7, 'redundancy': 3, 'mgid': 11} 2024-02-22 21:20:36.579924 DigProc: Adding multiwrite rule 192.168.1.87,N=3 - 11 2024-02-22 21:20:36.580053 DigProc: 192.168.1.87,7,4 2024-02-22 21:20:36.580118 DigProc: {'egressPort': 7, 'redundancy': 4, 'mgid': 12} 2024-02-22 21:20:36.580170 DigProc: Adding multiwrite rule 192.168.1.87,N=4 - 12 2024-02-22 21:20:36.580310 DigProc: Inserting RDMA metadata into ASIC... 2024-02-22 21:20:36.580390 DigProc: Setting up a new RDMA connection from virtual client... port 1336 dir /root/wly_experiment/dta_results/rdma_metadata/1336 2024-02-22 21:20:48.196762 DigProc: Reading collector metadata from disk... 2024-02-22 21:20:48.198298 DigProc: Collector metadata read from disk!