So, I booted into my Macintosh HD partition, and use disk utility to remove the Windows partition and the Microsoft Reserved partition. I couldn't install Microsoft Office either. That is not really a big problem to me, but then when I started using Windows, I couldn't find a way to make the audio drivers working. The installation went well, no errors were raised, but when I pressed the options key at startup to boot to Windows, my Mac recognized my Windows partition as 'EFI Boot' (so now I have 3 options when I pressed the Options key:Macintosh HD, EFI Boot, and Recovery). the partition where Windows is meant to be installed. In the part when I had to format my partitions for installation, Windows created 2 partitions in the free space: 1.
While installing, my Mac recognized the boot drive as 'EFI Boot' (when I pressed the options key to select the boot drive). A few days ago, I tried installing Windows 8.1 on my late 2011 Mac by using disk utility to make a free space on my disk and a Windows 8.1 boot drive to install.