Yvon still was not making much money from boxing. Even when he did well, he never saved very much. He would spend his prize money on boats and new cars. Durelle was a very fast driver and drove his cars very hard. Often, they didn’t last long before a new one was needed.

In 1952, he decided to join the Canadian Army. He wanted to be with his brothers and he needed the money. Yvon admits that he was not a very good soldier. He spent more time at home on leaves than he did at camp. His only work was to train army boxers in the gym. Durelle decided to leave this easy life in March, 1954, because he missed being home badly. Yvon never liked the big cities. He was always happier in his small home town. Durelle fought fifteen matches during his two years in the army.