In this study, ionic liquids were used for the selective extraction/isolation of hemoglobin from human serum for cotinine determination using the ELISA Kit. The suitability of hydrophobic imidazolium-based ionic liquids was tested, of which OMIM BF4 (1-methyl-3-octylimidazolium tetrafluoroborate) turned out to be the most suitable for direct extraction of hemoglobin into an ionic liquid without the use of any additional reagent at one extraction step. Hemoglobin was separated quantitatively (95% recovery) from the remaining types of proteins remaining in the aqueous phase. Quantum mechanical calculations showed that the interaction of the iron atom in the heme group and the nitrogen atom of the ionic liquid cation is responsible for the transfer of hemoglobin whereas molecular dynamics simulations demonstrated that the non-covalent interactions between heme and solvent are more favorable in the case of OMIM BF4 in comparison to water. The opposite trend was found for cotinine. Selective isolation of the heme/hemoglobin improved the ELISA test’s accuracy, depending on the cotinine level, from 15% to 30%.