• Research
• Open Access

# Instability of the Rayleigh problem with piecewise smooth steady states

Boundary Value Problems20162016:99

https://doi.org/10.1186/s13661-016-0609-4

• Received: 20 February 2016
• Accepted: 10 May 2016
• Published:

## Abstract

The present paper investigates the instability of the Rayleigh equation with piecewise smooth steady states. An existence result of a number of unstable modes for the Rayleigh problem is obtained.

## Keywords

• Rayleigh equation
• shear flow
• instability
• $$\mathcal{P}\mathcal{T}$$-symmetric
• eigenvalue problem

• 76E09
• 76E20
• 34B24

## 1 Introduction

Consider a plane shear flow $$\mathbf{U} = \mathbf{i}U(y)$$ within the channel, $$x\in(-\infty,\infty)$$ and $$y\in[-1,1]$$, a parallel shear flow in the x-direction. The linearized vorticity equation for a two-dimensional disturbance can be written as the equation (see  or )
$${\partial}_{t} w+U(y){\partial}_{x} w-U''(y){\partial}_{x}\psi=0,$$
(1.1)
where $$w=w(x,y,t)$$ is the vorticity perturbation, $$\psi=\psi(x,y,t)$$ is the associated stream function, which is related by
$$w=\nabla^{2}\psi=\frac{\partial^{2}}{\partial x^{2}}\psi +\frac{\partial^{2}}{\partial y^{2}}\psi$$
and the boundary condition $$\psi(x,\pm1,t)=0$$ for any $$x\in(-\infty ,\infty)$$.
By the normal mode method, or seeking the solutions of the form
$$\psi(x,y,t)=\varphi(y)e^{i\alpha(x-ct)}$$
with α the wave number (positive real) in the x-direction and $$c=c_{r} +\mathrm {i}\,c_{i}$$ the complex wave speed, we obtain the Rayleigh equation
$$\bigl(U(y)-c\bigr) \bigl(\varphi''- \alpha^{2}\varphi \bigr)-U''(y)\varphi=0,\quad \varphi=\varphi(y), y\in(-1,1),$$
(1.2)
with the boundary condition
$$\varphi(-1)=0, \qquad \varphi(1)=0.$$
(1.3)

So for shear flows, the instability problem is reduced to study the Rayleigh eigenvalue problems (1.2) and (1.3). This problem has a long history, going back to scientists such as Rayleigh and Kelvin in the 19th century (see ).

The flow is linearly unstable if some nontrivial solutions to (1.2) and (1.3) exist, with the imaginary part of c satisfying $$c_{i}:=\operatorname{Im}c>0$$. A classical result of Rayleigh  is the necessary condition for instability that the basic velocity profile should have an inflection point at some points $$y=y_{s}$$, that is, $$U''(y_{s})=0$$. This condition was later improved by Fjörtoft . However, it is far more difficult to obtain effective sufficient conditions for instability.

In 1935, Tollmien  obtained an unstable solution to (1.2) by formally perturbing around a neutral mode (i.e., c is a real number) for symmetric flows. In 1964, Rosenbluth and Simon  gave a necessary and sufficient integral condition for the monotone flows. Recently, some instability criteria for the special flows $$U(y)=\cos my$$ in  and $$U(y)=\sin my$$ in  have been obtained. These results were much improved and extended by Lin to more general odd symmetric flows in  and other classes of shear flows in .

We call a function $$U(y)$$ point symmetric with respect to $$c_{0}\in\mathbb{R}$$ if $$U(y)+U(-y)\equiv2c_{0}$$. For such $$U(y)$$ we define
$$K(y):=\frac{U''(y)}{U_{0}(y)},\quad U_{0}(y)=U(y)-c_{0}.$$
(1.4)
In the recent paper , the instability results were extended to the case where K is allowed to be unbounded, but integrable on $$[-1,1]$$.

### Proposition 1.1

(cf. Theorem 1.2 in )

Suppose that $$U(y)$$ is point symmetric, $$U(y)+U(-y)=2c_{0}$$, $$U\in{C^{2}}[-1,1]$$, and $$K\in L^{1}[-1,1]$$. If $$-\mathrm {d}^{2}/\mathrm {d}y^{2}+K(y)$$ with the boundary condition (1.3) has negative eigenvalues
$$\lambda _{1}< \lambda _{2}< \cdots< \lambda _{N}< 0,$$
then there is an unstable mode for every wave number $$\alpha\in\bigcup_{k=1}^{m_{0}}(\alpha _{2k},\alpha _{2k-1})$$, where $$m_{0}=[(N+1)/2]$$, the largest integer less than or equal to $$(N+1)/2$$, $$\alpha _{j}=\sqrt{-\lambda _{j}}$$ for $$1\le j\le N$$, and $$\alpha _{N+1}=0$$.

The present paper mainly focuses on the instability of the Rayleigh equation with piecewise smooth and point-symmetric velocity profiles $$U(y)$$, satisfying the requirement that $$U'(y)$$ exists continuously on $$[-1,1]$$ and $$U''(y)$$ exists on $$[-1,1]$$ except for a finite number of points. More general cases with piecewise smooth velocity profile were studied in .

### Proposition 1.2

(cf. Theorem 1.4 in )

Suppose that $$U(y)$$ is point symmetric, $$U\in C[-1,1]$$, and there exist $$2N+1$$ points $$\{y_{j}\}_{-N}^{N}$$ in $$[-1,1]$$ such that $$0=y_{0}< y_{1}<\cdots<y_{N}=1$$, $$y_{-j}=-y_{j}$$, and $$U(y)$$ is twice continuously differentiable for $$y\ne y_{j}$$, $$-N\le j\le N$$. If there exist constants $$C_{j}>0$$ and $$0\le\rho_{j}<1$$, $$0\le j\le N$$, such that
$$\bigl\vert U_{0}(y)\bigr\vert \ge C_{j} \vert y-y_{j}\vert ^{\rho_{j}} \quad \textit{ for } y \textit{ near } y_{j},$$
then there exists an $$\alpha_{c}>0$$ such that the Rayleigh problem of (1.2) with (1.3) has at least one unstable mode for every $$\alpha\in(0,\alpha_{c})$$.
Set
\begin{aligned} L_{\mathrm{loc}} \bigl([-1,0)\cup(0,1] \bigr) :=& \bigl\{ f \mbox{ is a measurable function on } [-1,0)\cup(0,1]: \\ &\mbox{for any compact subset } I\subset[-1,0)\cup(0,1], f\in L^{1}(I)\bigr\} . \end{aligned}
Clearly, $$L^{1}[-1,1]$$ is a proper subset of $$L_{\mathrm{loc}} ([-1,0)\cup(0,1] )$$. Then we can give the following instability criterion, which is the main result of this paper.

### Theorem 1.3

Let $$U\in\mathbf{C}[-1,1]$$ be point symmetric with respect to $$c_{0}\in \mathbb {R}$$ and there exist $$2N+1$$ points $$\{y_{j}\}_{-N}^{N}$$ in $$[-1,1]$$ such that $$0=y_{0}< y_{1}<\cdots<y_{N}=1$$, $$y_{-j}=-y_{j}$$, and $$U(y)$$ is twice continuously differentiable for $$y\ne y_{j}$$, $$-N\le j\le N$$. Let $$U_{0}$$ and K be defined in (1.4). Suppose that $$U_{0}'U^{k}_{0}$$ is bounded on $$[-1,1]$$ for sufficiently large k and
\begin{aligned} (\mathrm{i})&\quad K\in L_{\mathrm{loc}} \bigl([-1,0)\cup(0,1] \bigr),\qquad U_{0}(\pm1)\ne 0, \\ (\mathrm{ii})&\quad U_{0}(y)\sim a y^{\rho}\quad \textit{as } y\to0, 3/2>\rho>1/2, \rho \ne1, a\ne0. \end{aligned}
(1.5)
Let $$H(0)$$ be the differential operator in $$L^{2}(0,1]$$ associated to
$$-\varphi''+K\varphi=\lambda \varphi,\qquad \lim_{y\to0+} \bigl(\varphi'(y)U_{0}(y)- \varphi(y)U'_{0}(y) \bigr)=0,\qquad \varphi(1)=0.$$
(1.6)
If $$H(0)$$ has negative eigenvalues arranged in the order
$$\lambda _{1}< \lambda _{2}< \cdots< \lambda _{N}< 0,$$
then there is an unstable mode of the Rayleigh problem (1.2) and (1.3) for every wave number $$\alpha\in\bigcup_{k=1}^{m_{0}}(\alpha _{2k},\alpha _{2k-1})$$, where $$m_{0}=[(N+1)/2]$$, the largest integer less than or equal to $$(N+1)/2$$, $$\alpha _{j}=\sqrt{-\lambda _{j}}$$ for $$1\le j\le N$$, and $$\alpha _{N+1}=0$$.

Note that Proposition 1.1 studies the case where $$K\in L^{1}[-1,1]$$ and in Theorem 1.3 the function K is allowed not to be in $$L^{1}[-1,1]$$ ($$K\in L_{\mathrm{loc}} ([-1,0)\cup(0,1] )$$). Besides, Proposition 1.2 only gives the existence of an unstable mode in one interval of wave numbers, while Theorem 1.3 gives the existence of many unstable modes in a number of intervals of wave number if $$H(0)$$ has more than one negative eigenvalue. At the end of the present paper, we give an illustrative example in which $$H_{1}(0)\oplus H_{2}(0)$$ has more than one negative eigenvalue.

Since $$U''(y)$$ is allowed to be discontinuous at finite points in $$[-1,1]$$, this will result in different definitions of solutions of the Rayleigh equation and different Sturm-Liouville problems. For this reason, we will put much of attention on the properties of such solutions and corresponding eigenvalue problems. See Lemmas 2.1, 2.2, 2.4, and 2.5.

The main tools in the proof of Theorem 1.3 are the perturbation theory of operators in Hilbert spaces and the spectral theory of $$\mathcal{P}\mathcal{T}$$-symmetric differential operators.

Following this section, Section 2 presents some preliminary knowledge about the properties of solutions to the Rayleigh equation with piecewise smooth velocity profiles, the spectral properties of singular Sturm-Liouville problems with one singular end point and regular Sturm-Liouville problems with $$\mathcal{P}\mathcal{T}$$-symmetric potentials. The proof of the main result is given in Section 3 and the illustrative example is also given at the end of that section.

## 2 Preliminary knowledge

In this section, we first introduce properties of solutions of the Rayleigh equation with piecewise smooth velocity profiles and spectral properties of regular and singular Sturm-Liouville problems, especially the regular one with $$\mathcal{P}\mathcal{T}$$-symmetric potentials. We note that the assumptions of all lemmas in Section 2 and Section 3 are the same as in Theorem 1.3 and so are omitted for the sake of brevity.

### 2.1 Solutions of the Rayleigh equations

Since $$U''(y)$$ may be discontinuous at some junctions inside the interval, we must redefine the solution of the governing equation (1.2) and the eigenfunction to the Rayleigh eigenvalue problem in a weaker sense than the classical one.

For fixed $$\alpha ^{2}$$ and $$c=c_{r}+\mathrm {i}\,c_{i}$$ with $$c_{i}>0$$, consider the differential equation
$$-\varphi''+ \biggl(\frac{U''(y)}{U(y)-c}+ \alpha ^{2} \biggr)\varphi=\lambda \varphi,\quad y\in(-1,1),$$
(2.1)
involving the spectral parameter λ (cf. ). Set $$I_{j}=(y_{j},y_{j+1})$$, $$-N\le j\le N-1$$. A continuous function φ is called a solution of (2.1) on $$[-1,1]$$ if φ satisfies (2.1) on each $$I_{j}$$ and
$$\bigl(B(c)\varphi\bigr) (y):=(U-c)\varphi'-U' \varphi$$
(2.2)
can be extended to be absolutely continuous on $$[-1, 1]$$ (see ). If, for a λ, φ is a nonzero solution of (2.1) and satisfies the boundary condition (1.3), then we call λ an eigenvalue and φ the corresponding eigenfunction to (2.1) with the boundary (1.3) and, by convention, we call $$c=c_{r}+\mathrm {i}\,c_{i}$$ an eigenvalue and φ the corresponding eigenfunction of the Rayleigh problem (2.1) with (1.3).

Lemmas 3.1 and 3.2 in  show that such a solution is also uniquely determined by an initial value condition.

### Lemma 2.1

(cf. Lemmas 3.1 and 3.2 in )

For each initial value condition
$$\varphi(\xi)=a_{1},\qquad (B\varphi) (\xi)=a_{2}, \quad a_{1}, a_{2}\in \mathbb {C}, \xi\in[-1,1],$$
(2.3)
there exists a unique solution $$\varphi(y,c,\lambda)$$ of (2.1) in $$\mathbf{C}[-1,1]\cup\mathbf{C}^{1}([-1,0)\cup(0,1])$$. Furthermore, $$\varphi(y,c,\lambda)$$ is analytic in $$c_{i}>0$$ and λ.

Note, Lemma 2.1 implies that the corresponding eigen-subspace of every eigenvalue of (2.1) and (1.3) has exactly one dimension.

### Lemma 2.2

Let $$\varphi_{1}$$, $$\varphi_{2}$$ be two solutions of (2.1) with $$\operatorname {Im}c\ne0$$ and define the Wronskian $$W[\varphi_{1},\varphi_{2}]$$ of $$\varphi_{1}$$ and $$\varphi_{2}$$ for $$y\ne0$$:
$$W[\varphi_{1},\varphi_{2}](y)=\varphi_{1}(y) \varphi'_{2}(y)-\varphi '_{1}(y) \varphi_{2}(y).$$
Then there exists a constant $$C\in \mathbb {C}$$ such that $$W[\varphi_{1},\varphi_{2}](y)\equiv C$$ for $$y\ne0$$.

### Proof

Since $$\varphi_{1}$$, $$\varphi_{2}$$ are classical solutions of (2.1), $$W[\varphi_{1},\varphi_{2}](y)\equiv C_{\pm j}$$ on $$I_{\pm j}$$, $$0\le j\le N$$. On the other hand, $$B\varphi_{1}$$ and $$B\varphi_{2}$$ are both continuous on $$[-1,1]$$ and $$U_{0}W[\varphi_{1},\varphi_{2}](y)=\varphi_{1}B\varphi_{2}-\varphi _{2}B\varphi_{1}$$ is continuous by the continuity of $$\varphi_{k}$$ on $$[-1,1]$$, $$k=1,2$$, and hence $$U(y)-c\ne0$$ implies that $$W[\varphi_{1},\varphi_{2}]$$ is continuous on $$[-1,1]$$. As a result, $$C_{\pm j}\equiv C$$ for $$1\le j\le N$$. This proves Lemma 2.2. □

By Lemma 2.2 we can define the linearly dependent(resp. independent) solutions. Let $$\varphi_{1}$$, $$\varphi_{2}$$ be solutions of (2.1). If $$W[\varphi_{1},\varphi_{2}](y_{0})=0$$ for some $$y_{0}\in[-1,1]$$, then we say that $$\varphi_{1}$$, $$\varphi_{2}$$ are linearly dependent. Otherwise we say they are linearly independent.

### Lemma 2.3

Set
$$F(y, t)=t^{1/\rho-1} \int^{t^{-1/\rho}}_{yt^{-1/\rho}} \frac{\mathrm {d}s}{1+s^{2\rho}}, \quad y\in(0,1].$$
If $$\rho\in(0,3/2)$$, then there exists an $$F_{0}\in L^{2}(0,1]$$ such that $$F(y,t)\le F_{0}(y)$$ for all $$t\in(0,1]$$.

### Proof

For $$\rho\in(0,1/2)$$, we have, for $$t\in(0,1]$$,
\begin{aligned} F(y, t)&\le t^{1/\rho-1} \int^{t^{-1/\rho}}_{yt^{-1/\rho}}\frac {\mathrm {d}s}{s^{2\rho}} = \frac{1}{1-2\rho}t^{1/\rho-1} \bigl[ \bigl(t^{-1/\rho} \bigr)^{1-2\rho} - \bigl(yt^{-1/\rho} \bigr)^{1-2\rho} \bigr] \\ &\le\frac{1}{1-2\rho}t^{1/\rho-1}t^{-1/\rho+2}=\frac{t}{1-2\rho }\le \frac{1}{1-2\rho}. \end{aligned}
For $$\rho=1/2$$, we have, for $$t\in(0,1]$$,
$$F(y,t)=t\ln\frac{1+t^{-2}}{1+yt^{-2}}=t\ln\frac{1+t^{2}}{y+t^{2}}\le M,\quad y\in(0,1].$$
For $$1/2<\rho\le1$$, we have, for $$t\in(0,1]$$,
$$F(y,t)\le t^{1/\rho-1} \int^{\infty}_{0}\frac{\mathrm {d}s}{1+s^{2\rho }}\le M.$$
For $$3/2>\rho>1$$, we have, for $$t\in(0,1]$$,
\begin{aligned} F(y, t)&=t^{1/\rho-1} \int^{t^{-1/\rho}}_{yt^{-1/\rho}}\frac {1}{\rho s^{\rho-1}}\frac{\mathrm {d}s^{\rho}}{1+s^{2\rho}} \\ &\le\frac{y^{1-\rho}}{\rho}t^{1/\rho-1} \bigl(t^{-1/\rho} \bigr)^{1-\rho} \int^{\infty}_{0}\frac{\mathrm {d}u}{1+u^{2}} \le \frac{\pi y^{1-\rho}}{2\rho}. \end{aligned}
Since $$\rho<3/2$$, one sees that $$y^{1-\rho}\in L^{2}(0,1]$$. This completes the proof. □

### 2.2 Spectral properties of the corresponding differential operators

Consider the Sturm-Louville eigenvalue problem associated of (2.1) and (1.3) for $$c=c_{0}+\mathrm {i}\,c_{i}$$ with $$c_{i}>0$$ in $$L^{2}[-1,1]$$, i.e.,
$$-\varphi''+\bigl[K(y,c_{i})+ \alpha ^{2}\bigr]\varphi=\lambda \varphi,\qquad \varphi(\pm 1)=0,\quad K(y,c_{i})=\frac{U''(y)}{U_{0}(y)-\mathrm {i}\,c_{i}}.$$
(2.4)
Since $$U''\in L[-1,1]$$ and $$\vert K(y,c_{i})\vert \le U''/|c_{i}|$$, the problem is regular. Denote by $$H(c_{i})$$ the associated operator. If $$U(y)$$ is essentially odd, it is easy to see that $$\overline{K(y,c_{i})}=K(-y,c_{i})$$. This ensures that the operator $$H(c_{i})$$ is $$\mathcal{P}\mathcal{T}$$-symmetric for every $$c_{i}\in(0,\infty)$$, that is, $$H(c_{i})$$ is densely defined and
$$H(c_{i})\mathcal{P}\mathcal{T}\subset\mathcal{P}\mathcal{T}H(c_{i})$$
where $$\mathcal{P}$$ is the parity transformation: $$\varphi(y) \rightarrow\varphi(-y)$$ and $$\mathcal{T}$$ is the time reversal transformation: $$\varphi(y)\rightarrow\overline{\varphi(y)}$$. It is well known that the spectrum of a $$\mathcal{P}\mathcal {T}$$-symmetric operator is symmetric with respect to the real axis. As a result we have, for $$c_{i}>0$$,
$$\lambda \in\sigma\bigl(H(c_{i})\bigr)\quad \Longrightarrow \quad \overline{\lambda }\in\sigma \bigl(H(c_{i})\bigr), \quad c_{i}\in[0,\infty),$$
(2.5)
where $$\sigma(H(c_{i}))$$ is the spectrum of $$H(c_{i})$$.

Since (2.4) is regular, the operator $$H(c_{i})$$ has only countable discrete eigenvalues. The properties of eigenvalues were studied in  and it has been proved that the real parts of eigenvalues of (2.4) are bounded from below. The eigenvalues can be arranged in the dictionary order according to their real parts and imaginable parts. Then we write the countably many eigenvalues of $$H(c_{i})$$ as $$\{\lambda_{n}(c_{i})\}_{n\ge1}$$ in such an order and conclude from Theorem 2.2 of  the following.

### Lemma 2.4

(cf. Theorem 2.2 of )

We have
$$\lambda _{n}(c_{i})= \biggl(\frac{n\pi}{2} \biggr)^{2}+r(n,c_{i}),\quad \bigl\vert r(n,c_{i})\bigr\vert \le C(c_{i})n,$$
(2.6)
where the positive constant $$C(c_{i})$$ satisfies
$$C(c_{i})\le C_{0} \int^{1}_{-1}\bigl\vert K(y,c_{i})\bigr\vert \, \mathrm {d}y,$$
(2.7)
and the constant $$C_{0}$$ is independent of $$c_{i}$$. Moreover, there exists a positive integer $$N(c_{i})$$ depending only on $$c_{i}$$ such that, for $$n>N(c_{i})$$, $$\lambda _{n}(c_{i})$$ is algebraically simple.
Let $$H(0)$$ be the associated operator to
\begin{aligned} &E_{j}\mbox{: } {-}\varphi''+K(y) \varphi=\lambda \varphi, \\ &\lim_{y\to0+} \bigl(\varphi'(y)U_{0}(y) - \varphi(y)U_{0}'(y) \bigr)=0,\qquad \varphi(1)=0 \end{aligned}
(2.8)
in $$L^{2}(0,1]$$, where $$K(y)=U''(y)/U_{0}(y)$$. The operator $$H(0)$$ maybe singular with the possible singular end point $$y=0$$ since $$U''/U_{0}$$ is allowed to be not integrable on $$(0,1]$$. We prepare some basic results about the spectrum $$\sigma_{0}$$ of $$H(0)$$.

### Lemma 2.5

The operator $$H(0)$$ is self-adjoint and $$\sigma_{0}$$ contains only discrete, real and algebraically simple eigenvalues.

### Proof

By the condition (ii) of (1.5) there exists a $$\delta>0$$ such that $$U(y)\neq0$$ for $$y\in(0,\delta]$$. Let $$\varphi_{0}$$ be the solution of $$-\varphi''+K\varphi=0$$ satisfying
$$\varphi_{0}(\delta)=0, \qquad \varphi_{0}'( \delta)=\frac{1}{U_{0}(\delta)}.$$
Since $$K\in L^{1}_{\mathrm{loc}}(0,1]$$ in (i) of (1.5), we know that $$\varphi_{0}$$ exists on $$(0,1]$$ and is uniquely determined by the above initial value condition. Clearly $$\varphi_{0}\in L^{2}[\delta,1]$$. Since $$U_{0}(y)\ne0$$ on $$(0,\delta]$$, the explicit expression of $$\varphi_{0}$$ on $$(0,\delta]$$ is given by
$$\varphi_{0}(y)=U_{0}(y) \int^{y}_{\delta}\frac{1}{U_{0}^{2}},\quad y\in(0,\delta].$$
(2.9)
Applying $$U_{0}(y)\sim a y^{\rho}$$ as $$y\to0$$ and $$1/2<\rho<3/2$$ in (ii) of (1.5) we find that
$$\bigl\vert \varphi_{0}(y)\bigr\vert \le C_{1}y^{\rho}+C_{2}y^{1-\rho}\in L^{2}[0,\delta]$$
(2.10)
with some constants $$C_{1},C_{2}>0$$. Thus $$\varphi_{0}\in L^{2}[0,1]$$. Clearly, $$U_{0}$$ is the other linearly independent solution of $$-\varphi''+K\varphi=0$$ such that $$U_{0}\in L^{2}[0,1]$$, and hence all the solutions of $$-\varphi''+K\varphi=\lambda \varphi$$ belong to $$L^{2}[0,1]$$ for $$\lambda \in \mathbb {C}$$ by the variation of constants formula. This means that the equation in (2.8) is of limit circle type at $$y=0$$ by the classification of Weyl; see . Therefore, $$H(0)$$ with the separated and self-adjoint boundary conditions in (2.8) is self-adjoint, and hence all the conclusions of Lemma 2.2 are valid by the spectral theory of symmetric Sturm-Liouville differential operators. This completes the proof. □
Note that $$U(\pm1)\neq0$$. Denote by $$\varphi_{+}(y)$$, $$\varphi _{-}(y)$$ the solutions of $$-\varphi''+K\varphi=0$$ on $$(0,1]$$, $$[-1,0)$$, respectively, satisfying
$$\varphi_{\pm}(\pm1)=0,\qquad \varphi_{\pm}'( \pm1)=1/U_{0}(\pm1).$$
(2.11)
Since $$\varphi_{+}(1)=0$$ and the Wronsikian $$W[U_{0},\varphi_{+}]$$ of the two linearly independent solutions, $$U_{0}$$ and $$\varphi_{+}$$ satisfy
$$B\varphi_{+}(y)=W[U_{0},\varphi_{+}](y)=\varphi'_{+}(y)U_{0}(y)- \varphi _{+}(y)U_{0}'(y)\equiv1\quad \text{on } (0,1]$$
by Lemma 2.2, one sees that $$\varphi_{+}$$ is not an eigenfunction of $$H(0)$$. This means that $$\lambda=0$$ is not an eigenvalue of $$H(0)$$, and hence the resolvent $$(H(0)-z)^{-1}$$ of $$H(0)$$ at $$z=0$$ exists. By a computation, the integral expression of $$H^{-1}(0)$$ is given by
$$H^{-1}(0)f(y)= \int^{1}_{0}G_{0}(y,t) f(t)\, \mathrm {d}t,$$
(2.12)
where $$G_{0}(y,t)$$ is the Green function associated to $$H(0)$$ at 0 given by
$$G_{0}(y,t)= -\left \{ \textstyle\begin{array}{l@{\quad}l} U_{0}(t)\varphi_{+}(y), & 1>y>t>0, \\ U_{0}(y)\varphi_{+}(t), & 0< y< t< 1. \end{array}\displaystyle \right .$$
(2.13)
Equations (2.12) and (2.13) will be used in the proof of Lemma 3.3.

### 2.3 Convergence properties of solutions of (2.4) as $$c_{i}\to0+$$

Set
$$\varphi_{\pm}(y,c_{i})=\bigl(U_{0}(y)- \mathrm {i}\,c_{i}\bigr) \int^{y}_{\pm1}\frac {1}{(U_{0}-\mathrm {i}\,c_{i})^{2}},$$
(2.14)
$$I(\delta)=[\delta,1]$$ and $$I(-\delta)=[-1,-\delta]$$ for $$\delta \in(0,1)$$. Note that $$\varphi_{\pm}(y; c_{i})$$ belong to both $$L^{2}[-1,1]$$ and $$\mathbf{C}[-1,1]$$ for $$c_{i}>0$$. The following result gives the convergence properties for $$\varphi_{\pm}(y; c_{i})$$ in C-norm and $$L^{2}$$-norm.

### Lemma 2.6

Let $$\varphi_{\pm}(y; c_{i})$$ be defined in (2.14) and $$\varphi_{\pm}(y)$$ in (2.11), then as $$c_{i}\to0+$$,
$$\varphi_{+}(\cdot; c_{i})\to\varphi_{+} \quad \textit{in } C\bigl(I(\delta)\bigr),\qquad \varphi_{-}(\cdot; c_{i})\to\varphi_{-} \quad \textit{in } C\bigl(I(-\delta)\bigr)$$
(2.15)
for every $$\delta\in(0,1)$$ and
$$\varphi_{+}(\cdot; c_{i})\to\varphi_{+}\quad \textit{in } L^{2}(0,1], \qquad \varphi_{-}(\cdot; c_{i})\to\varphi_{-} \quad \textit{in } L^{2}[-1,0).$$
(2.16)

### Proof

Since $$K\in L(I(\pm\delta))$$ by the assumptions in Theorem 1.3, one can verify that $$K(\cdot,c_{i})\to K(\cdot)$$ in $$L(I(\pm\delta))$$ as $$c_{i}\to0+$$ for $$\delta\in(0,1)$$ by Lebesgue dominated convergence theorem. Note that
$$\varphi_{\pm}(\pm1,c_{i})=0,\qquad \varphi'_{\pm}( \pm1,c_{i})=\frac {1}{U_{0}(\pm1)-\mathrm {i}\,c_{i}}\to\frac{1}{U_{0}(\pm1)}= \varphi'_{\pm}(\pm1),$$
as $$c_{i}\to0$$. Then (2.15) is true by the theory of ordinary differential equations.
Let $$\delta>0$$ be sufficiently small such that $$|U_{0}(y)|\ge|a|y^{\rho}/2$$ for $$0< y\le\delta$$ by (ii) of (1.5). For $$y\in[\delta,1]$$, we see from (2.15), for $$0< c_{i}\le1$$, that there exists $$M(\delta)>0$$, independent of $$c_{i}$$, such that
$$\bigl\vert \varphi_{+}(y; c_{i})\bigr\vert \le M( \delta), \quad y\in[\delta,1].$$
(2.17)
For $$y\in(0,\delta)$$, we write $$\varphi_{+}(y,c_{i})$$ into
\begin{aligned} \varphi_{+}(y; c_{i}) =&\bigl(U_{0}(y)-\mathrm {i}\,c_{i}\bigr) \biggl( \int^{\delta}_{1} + \int^{y}_{\delta} \biggr)\frac{1}{(U_{0}-\mathrm {i}\,c_{i})^{2}} \\ =&\frac{U_{0}(y)-\mathrm {i}\,c_{i}}{U_{0}(\delta)-\mathrm {i}\,c_{i}}\varphi_{+}(\delta; c_{i}) +\bigl(U_{0}(y)- \mathrm {i}\,c_{i}\bigr) \int^{y}_{\delta}\frac{1}{(U_{0}-\mathrm {i}\,c_{i})^{2}}. \end{aligned}
(2.18)
The second term of the last expression in (2.18) is dominated by
$$\biggl\vert U_{0}(y) \int^{y}_{\delta}\frac{1}{(U_{0}-\mathrm {i}\,c_{i})^{2}}\biggr\vert +c_{i}\biggl\vert \int^{y}_{\delta}\frac{1}{(U_{0}-\mathrm {i}\,c_{i})^{2}}\biggr\vert \le \varphi_{0}(y)+c_{i} \int^{\delta}_{y}\frac{1}{U_{0}^{2}+c_{i}^{2}},$$
where $$\varphi_{0}(y)$$ is defined in (2.9). Since $$|U_{0}(y)|\ge|a| y^{\rho}/2$$ for $$0< y\le\delta$$,
\begin{aligned} c_{i} \int^{\delta}_{y}\frac{1}{U_{0}^{2}+c_{i}^{2}} &=\frac{2\hat{c}}{|a|} \int^{\delta}_{y}\frac{\mathrm {d}t}{t^{2\rho}+\hat{c}^{2}} \le\frac{2c_{i}}{|a|} \int^{|a|\delta/2}_{y}\frac{\mathrm {d}t}{t^{2}+c_{i}^{2}} \\ &=\frac{2\hat{c}^{1/\rho-1}}{|a|} \int^{\delta c^{-1/\rho}}_{y\hat{c}^{-1/\rho}}\frac{\mathrm {d}s}{s^{2\rho}+1}, \end{aligned}
where $$\hat{c}=2c_{i}/|a|$$. Then by Lemma 2.3 there exists an $$F_{0}\in L^{2}(0,1]$$ such that
$$c_{i} \int^{\delta}_{y}\frac{1}{U_{0}^{2}+c_{i}^{2}}\le F_{0}(y),\quad y\in(0,1]$$
for all $$c_{i}\in[-|a|/2,|a|/2]$$. Therefore,
$$\biggl\vert \bigl(U_{0}(y)-\mathrm {i}\,c_{i}\bigr) \int^{y}_{\delta}\frac{1}{(U_{0}-\mathrm {i}\,c_{i})^{2}}\biggr\vert \le \bigl\vert \varphi_{0}(y)\bigr\vert +F_{0}(y)$$
(2.19)
for $$y\in(0,\delta]$$ and all sufficiently small $$c_{i}>0$$.
Since $$U_{0}(\delta)\ne0$$, the first term of the last expression in (2.18) is clearly dominated by $$C_{1}|U_{0}(y)|+C_{2}$$ for $$c_{i}\le1$$ by (2.17). Therefore we conclude from (2.17), (2.18), and (2.19) that, for $$y\in(0,1]$$,
$$\bigl\vert \varphi_{+}(y; c_{i})\bigr\vert \le C_{1}\bigl\vert U_{0}(y)\bigr\vert +\bigl\vert \varphi _{0}(y)\bigr\vert +F_{0}(y)+C_{2}\in L^{2}(0,1]$$
(2.20)
for all sufficiently small $$c_{i}>0$$ by (2.10), where the constants $$C_{1}$$ and $$C_{2}$$ are independent of $$c_{i}$$. This together with (2.15) yields that $$\varphi_{+}(\cdot; c_{i})\to\varphi_{+}(\cdot)$$ in $$L^{2}(0,1]$$ as $$c_{i}\to0+$$ by Lebesgue dominated convergence theorem. Similarly, one can prove that $$\varphi_{-}(\cdot; c_{i})\to\varphi_{-}(\cdot)$$ in $$L^{2}[-1,0)$$ as $$c_{i}\to0+$$. The proof of Lemma 2.6 is finished. □

### Lemma 2.7

Let $$\varphi(y;\lambda ,c_{i})$$ be the solution of (2.1) such that $$\varphi(1;\lambda ,c_{i})=0$$ and $$\varphi'(1;\lambda ,c_{i})=1/U_{0}(1)$$ for $$c_{i}\ge0$$. Then $$\varphi(\cdot; \lambda ,c_{i})\to\varphi(\cdot; \lambda ,0)$$ as $$c_{i}\to0+$$ in $$L^{2}[0,1]$$.

### Proof

Let $$\varphi_{+}(y; c_{i})$$ be defined as in (2.14). Set
$$R(y,t,c_{i})=\bigl(U(y)+\mathrm {i}\,c_{i}\bigr)\varphi_{+}(t; c_{i})-\bigl(U(t)+\mathrm {i}\,c_{i}\bigr)\varphi _{+}(y; c_{i})$$
and $$R(y,t)=R(y,t,0)$$. By the variation of constants formula, the solution $$\varphi(y;\lambda ,c_{i})$$ can be expressed as
$$\varphi(y,\lambda ,c_{i})=\varphi_{+}(y; c_{i})+ \lambda \int^{y}_{1} R(y,t,c_{i})\varphi(t, \lambda ,c_{i})\, \mathrm {d}t,\quad y\in[0,1].$$
(2.21)
Since $$\varphi_{+}(\cdot; c_{i})\to\varphi_{+}$$ in $$L^{2}[0,1]$$ as $$c_{i}\to0+$$ by Lemma 2.6, we see that $$R(\cdot; c_{i})\to R$$ in $$L^{2}([0,1]\times[0,1])$$ as $$c_{i}\to0$$. Therefore, by a standard method we can prove the validity of the conclusion of Lemma 2.7. □
In the sequel we will use the quantity $$W(c_{i})$$ defined by
$$W(c_{i})= \int^{1}_{0}\frac{\mathrm {d}y}{(U_{0}(y)-ic_{i})^{2}}.$$
(2.22)

### Lemma 2.8

Under the assumptions in Theorem  1.3, $$|W(c_{i})|\to\infty$$ as $$c_{i}\to0+$$.

### Proof

Let $$\varphi_{\pm}(y; c_{i})$$ be defined in (2.14) and $$\varphi_{\pm}(y)$$ be defined in (2.11). Take $$\delta>0$$ sufficiently small such that $$U_{0}(\pm\delta)\ne0$$. Since $$\varphi_{\pm}(y; c_{i})\to\varphi _{\pm}(y)$$ as $$c_{i}\to0+$$ for all $$y>0$$ by (2.15), we get
$$\int^{\pm\delta}_{1}\frac{1}{(U_{0}-ic_{i})^{2}} =\frac{\varphi_{\pm}(\pm\delta; c_{i})}{(U_{0}(\pm\delta)-ic_{i})} \to\frac{\varphi_{\pm}(\pm\delta)}{U_{0}(\pm\delta)}\ne\infty$$
(2.23)
as $$c_{i}\to0+$$. It remains to prove that as $$c_{i}\to0+$$,
$$W(c_{i},\delta):= \int_{|y| \le\delta}\frac{1}{(U_{0}-ic_{i})^{2}}\to\infty.$$
(2.24)
To this end we set
\begin{aligned} F(c_{i}):&= \int^{\delta}_{0}\frac{U_{0}^{2}-c_{i}^{2}}{(U_{0}^{2}+c_{i})^{2}} = \int^{\delta}_{0}\frac{1}{U_{0}^{2}+c_{i}^{2}} -2c_{i}^{2} \int^{\delta}_{0}\frac{1}{(U_{0}^{2}+c_{i})^{2}} \\ &=:F_{1}(c_{i})-c_{i}F_{2}(c_{i}). \end{aligned}
(2.25)
Clearly $$W(c_{i},\delta)=2F(c_{i})$$ by the odd symmetry of $$U_{0}$$. Since $$U_{0}(y)\sim ay^{\rho}$$ as $$y\to0$$, we can choose $$\delta>0$$ sufficiently small such that $$|Ay|^{\rho}\le|U_{0}(y)|\le|By|^{\rho}$$ for $$|y|\le\delta$$ with $$0< A< B$$.
If $$1/2<\rho<1$$, then choose $$B-A$$ sufficiently small such that
$$1/B-(2-1/\rho)/A>0.$$
(2.26)
Then we have
$$F_{1}(c_{i})\ge \int^{\delta}_{0}\frac{\mathrm {d}y}{(By)^{2\rho}+c_{i}^{2}}, \qquad c_{i}F_{2}(c_{i})\le2c^{2}_{i} \int^{\delta}_{0}\frac{\mathrm {d}y}{((Ay)^{2\rho}+c_{i}^{2})^{2}}.$$
(2.27)
For the sake of simplicity, we take $$\delta=1$$ and $$t=c_{i}^{1/\rho}$$ in the following estimation:
\begin{aligned}& F_{1}(c_{i})=\frac{t^{1-2\rho}}{B} \int^{B/t}_{0}\frac{\mathrm {d}s}{s^{2\rho}+1} := \frac{t^{1-2\rho}}{B}I(B,t):=G(B,t), \\& c_{i}F_{2}(c_{i}) =-c_{i} \frac{\partial}{\partial c_{i}} \biggl( \int^{1}_{0}\frac {\mathrm {d}y}{(Ay)^{2\rho}+c_{i}^{2}} \biggr)=-c_{i} \frac{\partial}{\partial c_{i}}G(A,c_{i}) \\& \hphantom{c_{i}F_{2}(c_{i})}=-t^{\rho}\frac{\partial}{\partial t}G(A,t)\frac{\partial t}{\partial c_{i}} =- \frac{t}{\rho} \frac{\partial}{\partial t}G(A,t) \\& \hphantom{c_{i}F_{2}(c_{i})} =\frac{t^{1-2\rho}}{A}(2-1/\rho)I(A,t)+\frac{1}{\rho} \bigl(A^{2\rho }+t^{2\rho}\bigr)^{-1}. \end{aligned}
Therefore, $$I(B,t)>I(A,t)$$, $$\rho>1/2$$, and (2.26) lead to
$$W(c_{i},\delta)\ge t^{1-2\rho} \biggl(\frac{1}{B}- \frac{(2-1/\rho )}{A} \biggr)I(A,t) -\frac{1}{\rho}\bigl(A^{2\rho}+t^{2\rho} \bigr)^{-1}\to+\infty$$
as $$c_{i}\to0+$$. For the case $$1<\rho<3/2$$, we choose A, B satisfying
$$1/A-(2-1/\rho)/B< 0$$
(2.28)
and use similar inequalities in (2.27),
$$F_{1}(c_{i})\le \int^{\delta}_{0}\frac{\mathrm {d}y}{(Ay)^{2\rho}+c_{i}^{2}}, \qquad c_{i}F_{2}(c_{i})\ge2c^{2}_{i} \int^{\delta}_{0}\frac{\mathrm {d}y}{((By)^{2\rho}+c_{i}^{2})^{2}}.$$
(2.29)
Then a similar argument to the above proves that $$W(c_{i})\to-\infty$$ as $$c_{i}\to0+$$. This lemma is completed. □

Now we can outline the proof of Theorem 1.3 given in the next section. Recall the definition of $$\lambda _{k}(c_{i})$$, the eigenvalue of (2.4). Since there exists an unstable mode for a wave number α if and only if $$\lambda _{k}(c_{i})=0$$ for $$k\ge1$$, we only need to prove that $$H(c_{i})$$ has at least one zero eigenvalue for some $$c_{i}>0$$ under the assumptions in Theorem 1.3.

Consider the eigenvalues $$\lambda (c_{i})$$ of $$H(c_{i})$$ as functions of the variable $$c_{i}\in[0,\infty)$$. Applying the Kato-Rellich theorem (see e.g. , Theorem XII.8, p.15, IV, or , pp.437-439) as well as the resolvent convergence of $$H(c_{i})$$ in Lemma 3.1, we prove that $$\lambda (c_{i})$$ is a continuous function in the sense of (3.1). The main step is to prove the continuity of $$\lambda (c_{i})$$ at $$c_{i}=0$$. If this is done and $$\lambda _{k}(c_{i})\neq0$$ for all $$k\ge1$$ and $$c_{i}>0$$, then we can introduce an auxiliary function $$D(c_{i})$$ defined in (3.21) and prove that $$D(c_{i})$$ is continuous on $$(0,\infty]$$, $$D(c_{i})>0$$ for sufficiently large $$c_{i}>0$$, and $$D(c_{i})<0$$ for all sufficiently small $$c_{i}>0$$ by using several technical lemmas in Section 3. Therefore, the desired contradiction would appear.

## 3 The proof of Theorem 1.3

This section gives the proof of Theorem 1.3 through proving several lemmas. Recall that $$H(c_{i})$$ is the associated operator to (2.4) for $$c_{i}\in(0,\infty)$$ and the spectrum of $$H(c_{i})$$ is discrete. Denote by $$\lambda (c_{i})$$ the eigenvalue of $$H(c_{i})$$. The main step in this section is proving the continuity of $$\lambda (c_{i})$$ in the sense of that, if $$\lambda (c^{0}_{i})$$ is an eigenvalue of $$H(c^{0}_{i})$$ with algebraic multiplicity m and
$$O\bigl(\lambda \bigl(c^{0}_{i}\bigr),r\bigr)= \bigl\{ \lambda : \bigl\vert \lambda -\lambda \bigl(c^{0}_{i}\bigr)\bigr\vert \le r\bigr\} \cap\sigma \bigl(H\bigl(c^{0}_{i}\bigr) \bigr)=\bigl\{ \lambda \bigl(c^{0}_{i}\bigr)\bigr\} ,$$
(3.1)
then there exists $$\delta>0$$ such that, for $$|c_{i}-c^{0}_{i}|<\delta$$, $$O(\lambda (c_{i}),r)$$ contains eigenvalues of $$H(c_{i})$$ with total algebraic multiplicity exactly m. We remark that the above property is called ‘stableness of eigenvalue’ $$\lambda (c^{0}_{i})$$ for the case $$m=1$$ in , p.29.

The first lemma gives the continuity of $$\lambda (c_{i})$$ on $$(0,\infty)$$.

### Lemma 3.1

$$\lambda (c_{i})$$ is continuous on $$(0,\infty)$$.

### Proof

Let $$\varphi(y,c_{i},\lambda )$$ be the solution of
$$-\varphi''+\bigl[K(y,c_{i})+ \alpha ^{2}\bigr]\varphi=\lambda \varphi,\quad K(y,c_{i})= \frac{U''(y)}{U_{0}(y)-\mathrm {i}\,c_{i}},$$
such that $$\varphi(-1,c_{i}, \lambda )=0$$, $$\varphi'(-1,c_{i}, \lambda )=1$$. Since $$\varphi(1,c_{i},\lambda )$$ is analytic in $$(c_{i},\lambda )$$ for $$c_{i}>0$$ by Lemma 2.1, and λ is an eigenvalue of (2.4) for a fixed $$c_{i}>0$$ if and only if λ is a zero of $$\varphi(1,c_{i},\lambda )$$, it follows from the continuity of the zeros of an analytic function (, p.248) that $$\lambda _{n}(c_{i})$$ is continuous in the above sense. This lemma is completed. □

With a similar argument to the above one can prove the following.

### Lemma 3.2

$$\lambda (c_{i})$$ is continuous at $$c_{i}=\infty$$, where $$H(\infty)$$ is the differential operator associated to
$$-\varphi''+\alpha ^{2}\varphi=\lambda \varphi \quad \textit{in } L^{2}(-1, 1),\qquad \varphi(-1)=\varphi(1)=0.$$

### Proof

Set $$\eta=1/c_{i}$$ for $$c_{i}>0$$. Clearly, the eigenvalue problem (2.4) is equivalent to the eigenvalue problem
$$-\varphi''+ \biggl(\frac{\eta U''(y)}{\eta U_{0}(y)-\mathrm {i}\,}+ \alpha ^{2} \biggr)\varphi=\lambda \varphi, \qquad \varphi(\pm1)=0,$$
(3.2)
in $$L^{2}[-1, 1]$$. Let $$\varphi(y,\eta, \lambda )$$ be the solution of (3.2) which satisfies $$\varphi(-1,\eta, \lambda )=0$$, $$\varphi'(-1,\eta, \lambda )=1$$. Note that
$$\biggl\vert \frac{\eta U''(y)}{\eta U_{0}(y)-\mathrm {i}\,}\biggr\vert \le\eta\bigl\vert U''\bigr\vert \in L^{1}[-1,1].$$
Then $$\varphi(1,\eta, \lambda )$$ is analytic in $$(\eta, \lambda )$$ for $$\eta \ge0$$, and hence a similar argument to the above proves the continuity of eigenvalues at $$\eta=0$$, i.e., the continuity of $$\lambda (c_{i})$$ at $$c_{i}=\infty$$. □

The method in the proof of Lemmas 3.1 and 3.2 cannot be applied straightforwardly to the case $$c^{0}_{i}=0$$ since $$K(y,0)=K(y)$$ is not integrable in $$L^{1}[-1,1]$$. Then we first present necessary notations before proving the continuity of $$\lambda (c_{i})$$ at $$c_{i}=0$$. Let $$H(0)$$ be defined as in (2.8) with spectrum $$\sigma_{0}$$. Denote by $$\lambda (0)$$ the eigenvalue of $$H(0)$$. Then we can prove the following.

### Lemma 3.3

$$\lambda (c_{i})$$ is continuous at $$c_{i}=0$$.

### Proof

For $$c_{i}>0$$, it is easy to see from (2.14) that 0 is an eigenvalue of $$H(c_{i})$$ if and only if
$$W(c_{i}):= \int^{1}_{-1}\frac{1}{(U_{0}-\mathrm {i}\,c_{i})^{2}}=0.$$
Since $$|W(c_{i})|\to\infty$$ as $$c_{i}\to0+$$ by Lemma 2.8, one sees that 0 is not an eigenvalue of $$H(c_{i})$$ for all sufficiently small $$c_{i}>0$$, or the resolvent of $$H(c_{i})$$ at 0, say $$G(c_{i})$$, exists. Let $$G(y,t; c_{i})$$ be the associated Green function. A calculation shows that
$$G(y,t; c_{i})=-W^{-1}(c_{i}) \left \{ \textstyle\begin{array}{l@{\quad}l} \varphi_{-}(y;c_{i})\varphi_{+}(t; c_{i}), &-1\le y\le t\le1, \\ \varphi_{-}(t; c_{i})\varphi_{+}(y; c_{i}) ,&-1\le t\le y\le1. \end{array}\displaystyle \right .$$
(3.3)
Then $$H(c_{i})\varphi=\lambda \varphi$$ is equivalent to
$$\varphi=\lambda G(c_{i})\varphi=:\lambda \int^{1}_{-1}G(y,t;c_{i})\varphi (t)\, \mathrm {d}t.$$
(3.4)
Now we consider the limit of $$G(y,t,c_{i})$$ in $$L^{2}([-1,1]\times[-1,1])$$ as $$c_{i}\to0+$$.
For $$y>0$$, we have from (2.15) that
\begin{aligned} W^{-1}(c_{i})\varphi_{-}(y; c_{i},0)&=W^{-1}(c_{i}) \bigl(U_{0}(y)-ic_{i}\bigr) \biggl(W(c_{i}) + \int^{y}_{1}\frac{1}{(U_{0}-ic_{i})^{2}} \biggr) \\ &=\bigl(U_{0}(y)-ic_{i}\bigr)+W^{-1}(c_{i}) \varphi_{+}(y,c_{i},0)\to U_{0}(y), \end{aligned}
since $$W(c_{i})\to\infty$$ as $$c_{i}\to0+$$. Furthermore,
$$\bigl\vert W^{-1}(c_{i})\varphi_{-}(y; c_{i},0)\bigr\vert \le2\bigl(\bigl\vert U_{0}(y)\bigr\vert +1\bigr)\in L^{2}[-1,1]$$
for all sufficient small $$c_{i}$$, we know from the Lebesgue dominated convergence theorem that $$W^{-1}(c_{i})\varphi_{-}(y; c_{i},0)\to U_{0}(y)$$ in $$L^{2}[0,1]$$ as $$c_{i}\to0+$$. Similarly, one can prove that $$W^{-1}(c_{i})\varphi_{+}(y; c_{i},0)\to U_{0}(y)$$ in $$L^{2}[-1,0)$$ as $$c_{i}\to0+$$.
Therefore, we conclude from (3.3) and (2.16) that
$$G(y,t;c_{i},0)\to G_{+}(y,t)=-\left \{ \textstyle\begin{array}{l@{\quad}l} U_{0}(t)\varphi_{+}(y; 0,0),& 1>y>t>0, \\ U_{0}(y)\varphi_{+}(t; 0,0), & 0< y< t< 1, \end{array}\displaystyle \right .$$
(3.5)
in $$L^{2}([0,1]\times[0,1])$$ and
$$G(y,t;c_{i},0)\to G_{-}(y,t)=-\left \{ \textstyle\begin{array}{l@{\quad}l} U_{0}(y)\varphi_{-}(t; 0,0), & 0>y>t>-1, \\ U_{0}(t)\varphi_{-}(y; 0,0), & -1< y< t< 0, \end{array}\displaystyle \right .$$
(3.6)
in $$L^{2}([-1,0]\times[-1,0])$$.
For the case $$yt<0$$, we have
$$G(y,t;c_{i})=-W^{-1}(c_{i})\left \{ \textstyle\begin{array}{l@{\quad}l} \varphi_{+}(y; c_{i})\varphi_{-}(t; c_{i}),& y>0, t< 0, \\ \varphi_{+}(t; c_{i})\varphi_{-}(y; c_{i}),& y< 0, t>0. \end{array}\displaystyle \right .$$
(3.7)
Since $$\varphi_{+}(y; c_{i})$$ and $$\varphi_{-}(y; c_{i})$$ converge to $$\varphi_{+}(y)$$ in $$L^{2}[0,1]$$ and $$\varphi_{-}(y)$$ in $$L^{2}[-1,0]$$ by (2.16), respectively, as $$c_{i}\to0+$$, we find that $$G(y,t; c_{i},0)\to0$$ in $$L^{2}$$-norm as $$c_{i}\to0+$$ by Lemma 2.8.
Summing up the above discussion, we get, as $$c_{i}\to0+$$,
$$G(y,t;c_{i})\to G(y,t):=\left \{ \textstyle\begin{array}{l@{\quad}l} 0, &yt< 0, \\ G_{+}(y,t), & y>0, t>0, \\ G_{-}(y,t),& y< 0, t< 0, \end{array}\displaystyle \right .$$
(3.8)
in $$L^{2}([-1,1]\times[-1,1])$$. Applying the odd symmetry of $$U_{0}(y)$$ in $$[-1,1]$$ and the definitions of $$\varphi_{\pm}(y)$$, one can verify that $$\varphi_{+}(y)=\varphi_{-}(-y)$$ for $$y\neq0$$. Therefore,
$$G(-y,-t)=G(y,t), \quad yt>0, y,t\in[-1,1],$$
(3.9)
by the definitions of $$G_{+}$$, $$G_{-}$$ in (3.5), (3.6), respectively. As a result, the limitation eigenvalue problem of the operators $$G(c_{i})$$ as $$c_{i}\to0+$$ can be expressed as
$$\varphi=\lambda G\varphi \quad \text{in } L^{2}[-1,1], \qquad (G\varphi) (y):= \int ^{1}_{-1}G(y,t)\varphi(t)\, \mathrm {d}t, \quad y \in[-1,1].$$
(3.10)
Since $$G(\cdot,\cdot)\in L^{2}([-1,]\times[-1,1])$$, this means that G is a Hilbert-Smith operator, and hence every nonzero spectral point is an isolated eigenvalue.
Now consider the eigenvalue problem $$H(0)\varphi=\lambda \varphi$$, or
$$\varphi(y)=\lambda \int^{1}_{0}G_{+}(y,t)\varphi(t)\, \mathrm {d}t =\lambda \int^{1}_{0}G(y,t,0)\varphi(t)\, \mathrm {d}t$$
(3.11)
for $$y>0$$ by (2.12) and (3.8). By (3.9), one can verify that $$\varphi(y)$$ solves (3.11) if and only if $$\varphi(-y)$$ solves
$$\varphi(-y)=\lambda \int^{0}_{-1}G_{-}(y,t)\varphi(-t)\, \mathrm {d}t =\lambda \int^{0}_{-1}G(y,t,0)\varphi(-t)\, \mathrm {d}t$$
(3.12)
for $$y<0$$. This clearly shows that $$\varphi(y)$$ solves (3.11) if and only if $$\Phi(y)$$ satisfies
$$\Phi(y)=\lambda \int^{1}_{-1}G(y,t,0)\Phi(t)\, \mathrm {d}t,\qquad \Phi(y)= \left \{ \textstyle\begin{array}{l@{\quad}l} \varphi(y), & y>0, \\ \varphi(-y),& y< 0, \end{array}\displaystyle \right .$$
(3.13)
which means that λ is an eigenvalue of (3.13) if and only if λ is an eigenvalue of (3.11). Since every eigenvalue of $$H(0)$$ is isolated and algebraically simple, it follows from , Lemma 1, p.29, that $$\lambda (c_{i})$$ is continuous at $$c_{i}=0$$. The proof is finished. □

For the convenience of applications of Lemmas 3.1-3.3 in the proof of Theorem 1.3, we give a detailed description of the continuity of $$\lambda (c_{i})$$ by summing up the conclusions in Lemmas 3.1-3.3.

### Lemma 3.4

The eigenvalue $$\lambda(c_{i})$$ of $$H(c_{i})$$ is continuous on $$[0,\infty]$$ in the sense that, for a fixed eigenvalue $$\lambda(c^{0}_{i})$$ of $$H(c^{0}_{i})$$ with the algebraically multiplicity m and a neighborhood $$O(\lambda(c^{0}_{i}))$$ of $$\lambda(c^{0}_{i})$$ such that $$O(\lambda(c^{0}_{i}))\cap\sigma(H(c^{0}_{i}))=\{\lambda(c^{0}_{i})\}$$, there exists a neighborhood $$O(c^{0}_{i})$$ of $$c^{0}_{i}$$ such that, for $$c_{i}\in O(c^{0}_{i})$$, $$O(\lambda(c^{0}_{i}))$$ contains m eigenvalues $$\lambda(c_{i})$$ of $$H(c_{i})$$.

In fact, Lemma 3.3 gives the resolvent convergence of $$H(c_{i})$$ as $$c_{i}\to0+$$. Using this fact we can prove the following.

### Lemma 3.5

If $$c^{n}_{i}\to0$$ and the limit λ̂ of $$\lambda (c^{n}_{i})$$ is finite as $$n\to\infty$$, then λ̂ is an eigenvalue of $$H(0)$$.

### Proof

Choose $$z_{0}\notin\sigma(H(0))$$. By Lemma 3.4 $$z_{0}\notin\sigma(H(c^{n}_{i}))$$ for n sufficiently large. Set
$$G_{n}=\bigl(H\bigl(c^{n}_{i}\bigr)-z_{0} \bigr)^{-1}, \qquad G_{0}=\bigl(H(0)-z_{0} \bigr)^{-1}, \qquad \lambda _{n}=\lambda \bigl(c^{n}_{i} \bigr)-z_{0},\qquad \lambda _{0}=\hat{\lambda }-z_{0}.$$

Let $$\varphi_{n}\in L^{2}(-1,1)$$ be the corresponding normalized eigenvector corresponding to the eigenvalue $$\lambda _{n}$$ of $$H(c^{n}_{i})-z_{0}$$, or $$\varphi_{n}=\lambda _{n}G_{n}\varphi_{n}$$.

Since $$G_{0}$$ is compact and $$\|\varphi_{n}\|=1$$, there exists a convergent subsequence of $$\{G_{0}\varphi_{n}\}$$, say $$\{G_{0}\varphi_{n}\}$$. Then we have
\begin{aligned} \Vert \varphi_{n}-\varphi_{m}\Vert &= \Vert \lambda _{n} G_{n}\varphi_{n}- \lambda _{m} G_{m}\varphi_{m}\Vert \\ &\le|\lambda _{n}|\bigl\Vert (G_{n}-G_{m}) \varphi_{n}\bigr\Vert +|\lambda _{n}-\lambda _{m}|\Vert G_{m}\varphi_{n}\Vert +|\lambda _{m}|\bigl\Vert G_{m}(\varphi_{n}-\varphi_{m})\bigr\Vert . \end{aligned}
(3.14)
However,
$$\bigl\Vert G_{m}(\varphi_{n}- \varphi_{m})\bigr\Vert \le\bigl\Vert (G_{m}-G_{0}) \varphi_{n}\bigr\Vert +\bigl\Vert (G_{0}-G_{m}) \varphi_{m}\bigr\Vert +\bigl\Vert G_{0}( \varphi_{n}-\varphi_{m})\bigr\Vert .$$
(3.15)
Since $$\|G_{n}-G_{0}\|\to0$$, $$\lambda _{n}-\lambda _{m}\to0$$, $$G_{0}(\varphi_{n}-\varphi_{m})\to0$$ as $$n\to\infty$$, we conclude from (3.14) and (3.15) that $$\{\varphi_{n}\}$$ is a Cauchy sequence. Set $$\varphi_{n}\to\varphi_{0}$$ as $$n\to\infty$$. Then $$\varphi_{0}\neq0$$ since $$\|\varphi_{n}\|=1$$. Clearly
\begin{aligned} \Vert \varphi_{0}-\lambda _{0} G_{0} \varphi_{0}\Vert \le&\Vert \varphi_{0}- \varphi_{n}\Vert +|\lambda _{n}|\bigl\Vert (G_{n}-G_{0})\varphi_{n}\bigr\Vert \\ &{}+|\lambda _{n}-\lambda _{0}|\Vert G_{0} \varphi_{n}\Vert +|\lambda _{0}|\bigl\Vert G_{0}( \varphi_{n}-\varphi_{0})\bigr\Vert \to0 \end{aligned}
as $$n\to\infty$$ gives $$\varphi_{0}=\lambda _{0} G_{0} \varphi_{0}$$. This together with $$\varphi_{0}\neq0$$ implies that λ̂ is an eigenvalue of $$H(c^{0}_{i})$$. The proof is completed. □

The following result gives a lower bound of the real eigenvalues of $$H(c_{i})$$.

### Lemma 3.6

There exists $$M>0$$ such that for any real eigenvalue $$\lambda (c_{i})$$ of $$H(c_{i})$$ for $$c_{i}>0$$ we have $$\lambda (c_{i})\ge-M$$.

### Proof

Let $$\varphi(y,c_{i})$$ be the eigenfunction corresponding to $$\lambda (c_{i})$$ such that $$\varphi(1,c_{i})=0$$, $$\varphi'(1,c_{i})=1$$. Choose m sufficiently large such that $$U_{0}'U_{0}^{m-1}$$ is bounded in $$[0,1]$$, i.e., there exists $$M>0$$ such that
$$\bigl\vert U_{0}'U_{0}^{m-1}(y)\bigr\vert \le M.$$
Since $$\lambda (c_{i})$$ is real, multiplying both sides of (2.1) by $$U^{2m}_{0}\overline{\varphi}$$ and integrating by parts on $$[0,1]$$ we find that the real part is given by
\begin{aligned}& 2m \int^{1}_{0} U^{2m-1}_{0}U'_{0} \operatorname {Re}\bigl(\varphi'\varphi\bigr) + \int^{1}_{0} \biggl(U_{0}^{2m}\bigl| \varphi'\bigr|^{2} +\frac{U''U^{2m+1}_{0}}{U_{0}^{2}+c^{2}_{i}}|\varphi|^{2} \biggr) \\& \quad =\lambda (c_{i}) \int^{1}_{0}U_{0}^{2m}| \varphi|^{2}. \end{aligned}
(3.16)
Here $$U_{0}(0)=0$$ is used. By Lemma 2.7 $$\varphi(y,c_{i})\to g(y)$$ in $$L^{2}(0,1]$$ as $$c_{i}\to0$$, where $$g(y)$$ is the solution of
$$-\phi''+ \biggl(\frac{U''}{U_{0}}+\alpha ^{2} \biggr) \phi=\lambda \phi$$
such that $$g(1)=0$$, $$g'(1)=1$$.
Set
$$C_{1}= \int^{1}_{0}\bigl\vert g(y)\bigr\vert ^{2}\, \mathrm {d}y, \qquad C_{2}= \int^{1}_{0} U_{0}^{2m}(y)\bigl\vert g(y)\bigr\vert ^{2}\, \mathrm {d}y.$$
(3.17)
Then there exists $$\delta>0$$ such that, for $$c_{i}<\delta$$,
$$\int^{1}_{0}\bigl\vert \varphi( \cdot,c_{i})\bigr\vert ^{2}\le2C_{1},\qquad \int ^{1}_{0}U_{0}^{2m}\bigl\vert \varphi(\cdot,c_{i})\bigr\vert ^{2}>C_{2}/2.$$
(3.18)
Since $$U_{0}(0)=0$$ and $$\varphi(1,c_{i})=0$$, integration by parts shows that
\begin{aligned} \int^{1}_{0}\frac{U''U^{2m+1}_{0}}{U_{0}^{2}+c^{2}_{i}}|\varphi|^{2} =&\frac{U'U^{2m+1}_{0}}{U_{0}^{2}+c^{2}_{i}}|\varphi|^{2}\bigg|^{1}_{0}- \int^{1}_{0}U' \biggl( \frac{U^{2m+1}_{0}}{U_{0}^{2}+c^{2}_{i}}|\varphi|^{2} \biggr)' \\ =&-2 \int^{1}_{0}\frac{U'U^{2m+1}_{0}}{U_{0}^{2}+c^{2}_{i}}\operatorname {Re}\bigl( \varphi'\varphi\bigr) - \int^{1}_{0}U' \biggl(\frac{U^{2m+1}_{0}}{U_{0}^{2}+c^{2}_{i}} \biggr)'|\varphi|^{2}. \end{aligned}
A calculation shows that (by the continuity of $$U_{0}$$)
$$\biggl\vert U' \biggl(\frac{U^{2m+1}_{0}}{U_{0}^{2}+c^{2}_{i}} \biggr)' \biggr\vert \le C_{m}$$
and hence
$$\int^{1}_{0}\frac{U''U^{2m+1}_{0}}{U_{0}^{2}+c^{2}_{i}}\vert \varphi \vert ^{2} \ge-2 \int^{1}_{0}\bigl\vert U^{2m-1}_{0}U'_{0} \varphi'\varphi\bigr\vert -C_{m} \int^{1}_{0}\vert \varphi \vert ^{2}.$$
(3.19)
For the first term in the above inequality we have
\begin{aligned} \int^{1}_{0} \bigl\vert U^{2m-1}_{0}U'_{0} \varphi'\varphi\bigr\vert \le& \biggl( \int^{1}_{0} \bigl(U'U^{m-1}_{0} \bigr)^{2}\vert \varphi \vert ^{2} \biggr)^{1/2} \biggl( \int^{1}_{0} U_{0}^{2m}\bigl\vert \varphi'\bigr\vert ^{2} \biggr)^{1/2} \\ \le&\frac{1}{2m+2} \int^{1}_{0} U^{2m}_{0}\bigl\vert \varphi'\bigr\vert ^{2}+(m+1) \int ^{1}_{0}\bigl(U'U^{m-1}_{0} \bigr)^{2}\vert \varphi \vert ^{2}. \end{aligned}
(3.20)
Inserting the inequalities (3.18)-(3.20) into (3.16) we have $$\lambda (c_{i})\ge-2(m+1)^{2}C_{1}C_{m}/C_{2}$$. The proof of Lemma 3.6 is finished. □

### Proof of Theorem 1.3

Let $$\lambda _{n}(c_{i})$$ be defined as above with the multiplicity $$n_{k}(c_{i})$$. Recall that $$H(0)$$ has N negative eigenvalues $$\lambda _{1}<\lambda _{2}<\cdots<\lambda _{N}<0$$, and $$m_{0}=[(N+1)/2]$$, $$\alpha _{j}=\sqrt{-\lambda _{j}}$$, $$1\le j\le N$$, $$\alpha _{N+1}=0$$. We proceed to show that, for every $$\alpha \in\bigcup_{k=1}^{m_{0}}(\alpha _{2k},\alpha _{2k-1})$$, there exist $$c_{i}>0$$ and $$k\ge1$$ such that $$\lambda_{k}(c_{i})=0$$. Assume to the contrary that, for an $$\alpha \in(\alpha _{2j}, \alpha _{2j-1})$$ with $$1\le j\le m_{0}$$, $$\lambda_{k}(c_{i})\ne0$$ for all $$c_{i}\in(0,\infty)$$, and $$k\ge1$$. Then, by Lemma 2.4, we can define
$$D(c_{i})=\prod^{\infty}_{k=1} \bigl(1-e^{-\lambda _{k}(c_{i})} \bigr)^{n_{k}(c_{i})},\quad c_{i}\in(0, \infty),$$
(3.21)
to be a function because the infinite product converges to a finite nonzero number for every $$c_{i}>0$$ and $$c_{i}=\infty$$. Fixing $$c^{0}$$ with $$c^{0}_{i}>0$$, for all $$c_{i}\in(c^{0}, \infty)$$, since the remainder in (2.6) satisfies $$|r(n,c_{i})|\le C(c_{i})n$$ and $$C(c_{i})$$ is dominant by $$C_{0}\int^{1}_{-1}|K(y,c_{i})|\, \mathrm {d}y$$ and $$|K(y,c_{i})|\le|K(y,c^{0}_{i})|$$, the infinite product in (3.21) converges uniformly on $$(c^{0}_{i}, \infty)$$. Moreover, since $$\lambda_{k}(c_{i})$$ appears in complex conjugate pairs, $$D(c_{i})$$ is real-valued.

Note that $$1-e^{-\lambda _{k}(\infty)}>0$$ for $$k\ge1$$ since $$\lambda _{k}(\infty)= (\frac{k\pi}{2} )^{2}+\alpha ^{2}>0$$ by the definition of $$H(\infty)$$ in Lemma 3.2. Then $$D(\infty)>0$$. If $$D(c_{i})<0$$ for some $$c_{i}>0$$ and $$D(c_{i})$$ is continuous on $$(0,\infty)$$, then we will have the desired contradiction.

First of all we prove that $$D(c_{i})<0$$ for some $$c_{i}>0$$. Precisely, we will prove that there exists $$\delta>0$$ such that
$$D(c_{i})< 0,\quad c_{i}\in(0,\delta).$$
Since for $$c_{i}=0$$, $$\lambda _{k}(0)=\lambda _{k}+\alpha ^{2}$$ and $$n_{k}(c_{i})=1$$ for all k. Then for $$\alpha \in(\alpha _{2j},\alpha _{2j-1})$$, it is easy to see that the first $$2j-1$$ eigenvalues $$\lambda _{1}(0),\ldots,\lambda_{2j-1}(0)$$ are negative and the rest are all positive. Choose $$\varepsilon>0$$ small enough such that
$$O_{k}=\bigl\{ \lambda \in \mathbb {C}: \bigl\vert \lambda -\lambda _{k}(0)\bigr\vert < \varepsilon\bigr\} ,\quad 1\le k\le2j-1, O_{k}\cap O_{m}=\emptyset, k\neq m.$$
Then by Lemma 3.4, there exists $$\delta>0$$ such that $$O_{k}$$ contains exactly one simple eigenvalue of $$H(c_{i})$$ for all $$c_{i}<\delta$$, say $$\lambda _{1}(c_{i}),\ldots,\lambda_{2j-1}(c_{i})$$. Since $$\overline{\lambda _{k}(c_{i})}$$ is also an eigenvalue of $$H(c_{i})$$, then by the simpleness $$\lambda _{1}(c_{i}),\ldots,\lambda_{2j-1}(c_{i})$$ are all real.
If $$\lambda _{1}(c_{i}),\ldots,\lambda_{2j-1}(c_{i})$$ are all the negative eigenvalues of $$H(c_{i})$$, then we must have $$D(c_{i})<0$$ since the number is odd and non-real eigenvalues appear in complex conjugate pairs. Suppose that for any integer $$N>0$$ there exists a $$c^{N}_{i}$$ such that
$$c^{N}_{i}< 1/N,\qquad \lambda \bigl(c^{N}_{i} \bigr)< 0, \qquad \lambda \bigl(c^{N}_{i}\bigr)\neq \lambda _{k}\bigl(c^{N}_{i}\bigr)$$
for $$1\le k\le2j-1$$. This also means that
$$\lambda \bigl(c^{N}_{i}\bigr)\notin O_{k},\quad 1\le k\le2j-1,$$
by the definition of $$\lambda _{k}(c^{N}_{i})$$. By Lemma 3.6, $$\lambda (c^{N}_{i})$$ is bounded for all $$N\ge1$$. Then there exists a convergent subsequence, say $$\{\lambda (c^{N}_{i})\}$$. Let $$\lambda _{0}$$ be the limit of $$\{\lambda (c^{N}_{i})\}$$ as $$N\to\infty$$, then Lemma 3.5 implies that $$\lambda _{0}$$ is an eigenvalue of $$H(0)$$. Since $$\lambda (c^{N}_{i})<0$$ and $$\lambda (c^{N}_{i})\notin O_{k}$$, we see that $$\lambda _{0}\le0$$ and $$\lambda _{0}\neq \lambda _{k}(0)$$ for $$1\le k\le2j-1$$. But $$H(0)$$ has no other negative eigenvalue except for $$\lambda _{1}(c_{i}),\ldots,\lambda_{2j-1}(c_{i})$$, we must have $$\lambda _{0}=0$$. This is also a contradiction since $$H(0)$$ has no zero eigenvalue.

Now we prove the continuity of $$D(c_{i})$$ on $$(0, \infty)$$ provided that $$D(c_{i})\neq0$$. Let $$c_{i}^{0}\in(0,\infty)$$ and $$\varepsilon>0$$ be given. Suppose that $$\mu_{1},\ldots,\mu_{m}$$ are the first m distinct eigenvalues of $$H(c^{0}_{i})$$ and that each $$\mu_{j}$$ has a multiplicity $$n_{j}$$ and $$n_{1}+\cdots+n_{m}=M_{m}$$. Then $$\{M_{m}\}$$ is increasing and the continuity of $$D(c_{i})$$ is equivalent to the continuity of the partial product $$D_{m}(c_{i}):=\prod_{k=1}^{M_{m}}(1-e^{-\lambda_{k}(c_{i})})^{n_{k}(c_{i})}$$ for every m because of the uniform convergence of the infinite product.

Choose an $$\eta>0$$ so small that, for $$1\le j\le m$$, $$\mu_{j}$$ is the only eigenvalue of $$H(c_{i}^{0})$$ in the disc $$O_{j}=\{\lambda : |\lambda -\mu_{j}|<\eta \}$$ and $$\partial O_{j}\cap\sigma(H(c^{0}_{i}))=\emptyset$$. Furthermore, η can be chosen sufficiently small such that, for $$\lambda \in O_{j}$$, $$1\le j\le m$$,
$$\bigl\vert \ln\bigl\vert 1-e^{-\lambda }\bigr\vert - \ln \bigl\vert 1-e^{-\mu_{j}}\bigr\vert \bigr\vert < \varepsilon/M_{m}.$$
(3.22)
Then by Lemma 3.4, there exists $$\delta>0$$ such that $$O_{j}$$ contains exactly $$n_{j}$$ eigenvalues of $$H(c_{i})$$ for $$c_{i}$$: $$|c_{i}-c_{i}^{0}|<\delta$$. Therefore, we have from (3.22), for $$|c_{i}-c_{i}^{0}|<\delta$$,
$$\bigl\vert \ln\bigl\vert D_{m}(c_{i})\bigr\vert - \ln\bigl\vert D_{m}\bigl(c^{0}_{i}\bigr)\bigr\vert \bigr\vert < \varepsilon.$$
This gives the continuity of $$D_{m}(c_{i})$$ and completes the proof of Theorem 1.3. □

### Example 3.7

Take $$U(y)=y^{\rho}(2-y^{n})$$ with $$\rho=3/5$$ and n an even number. Then $$H(0)$$ is given by
\begin{aligned} &{-}\varphi''- \biggl( \frac{n(n+2\rho-1)}{2-y^{n}}y^{n-2}+\rho(1-\rho )y^{-2} \biggr)\varphi = \lambda \varphi, \quad y\in(0,1], \\ &\bigl[y^{\rho}\varphi'(y)-\rho y^{\rho-1}\varphi(y) \bigr] \big|_{y=0}=0,\qquad \varphi(1)=0. \end{aligned}
(3.23)
Since $$H(0)$$ has at least m negative eigenvalues for $$n>2(m+2)^{2}\pi^{2}$$, we know from Theorem 1.3 that the Rayleigh problem has at least k unstable modes if $$\alpha<\sqrt{|\lambda _{k}|}$$, $$1\le k\le m$$.

## Declarations

### Acknowledgements

This research was partially supported by the NNSF of China (Grants 11271229 and 11471191), the NSF of Shandong (Grants ZR2015AM019), the BSRP of Shandong University (Grants 2015ZQXM2010 and 2015ZQXM2012), the PIP of Shandong (Grant 201301010) and the PSF of China (Grants 125367 and 2015M580583). 