Integral equation methods are frequently used in the numerical solution of elliptic boundary value problems. After giving a brief overview of the advantages and disadvantages of such methods vis-a-vis more direct techniques like finite element methods, I will discuss two problems which arise in integral equation methods. In both cases, I take a contrarian position. The first is the discretization of integral operators on singular domains (e.g., surfaces with edges and curves with corners). The consensus opinion holds that integral equations given on such domains are exceedingly difficult to discretize and that sophisticated analysis, often specific to a particular boundary value problem, is required. I will explain that, in fact, the efficient solution of a broad class of such problems can be effected using an elementary approach. Exterior scattering problems given on planar domains with tens of thousands of corner points can be solved to 12 digit accuracy on my two year old desktop computer in a matter of hours. The second problem I will discuss is the evaluation of the singular integrals which arise form the discretization of weakly singular integral operators given on surfaces. Exponentially convergent algorithms for evaluating these integrals have been described in the literature and it is widely regarded as a "solved" problem. I will explain why this is not so and describe an approach which yields only algebraic convergence, but nonetheless performs better in practice than standard exponentially convergent methods.