Existence of least energy sign-changing solution for the nonlinear Schrödinger system with two types of nonlocal terms

Abstract

In the paper, we are concerned with the system of Kirchhoff-Schrödinger-Poisson system under certain assumptions on $V_{1}$, $V_{2}$, K and f. We are interested in the existence of least energy sign-changing solutions to the system on $\mathbb{R}^{N}$. Because two kinds of nonlocal terms $\phi_{u}$ and $\int_{\mathbb{R}^{N}}|\nabla u|^{2}$ are involved in the system, the methods are different from the Kirchhoff or the Schrödinger-Poisson system. The two nonlocal terms $\int_{\mathbb{R}^{N}}|\nabla u|^{2}$ and $\phi_{u}$ make that the functional $J(u^{+}+u^{-})\neq J(u^{+})+J(u^{-})$. Moreover, the nonlocal term $\phi_{u}$ does not have the convergence property because of the assumption $V_{2}$. In addition, the convergence of these two nonlocal terms are different. In the present paper, we unify the increasing property conditions on sign-changing solution in previous papers. We construct a new homotopy operator and then weaken the assumption that f is $C^{1}$ to that of f being only continuous. We prove that the system has a sign-changing solution via a constraint variational method combining with Brouwer’s degree theory.

1 Introduction

In this paper, we consider the nonlinear Kirchhoff-Schrödinger-Poisson system

$$ \left \{ \textstyle\begin{array}{l@{\quad}l} -(1+b\int_{\mathbb{R}^{{N}}}|\nabla u|^{2})\Delta u+V_{1}(x)u+V_{2}(x)\phi u=K(x)f(u), &x\in\mathbb{R}^{N}, \\ -\Delta\phi=V_{2}(x)u^{2},&x\in\mathbb{R}^{N}, \end{array}\displaystyle \right . $$

(1.1)

for $3\leq N\leq5$. System (1.1) with $b=0$ has been introduced while looking for the existence of standing waves for the Schrödinger equation acting with an electrostatic field. We refer to [1] and the references therein for more details as regards the physics aspects. This problem is called the Schrödinger-Poisson system. If $V_{2}=0$, system (1.1) is the Kirchhoff equation, which is the stationary problem associated to the time-dependent problem, which models small vertical vibrations of an elastic string [2].

In recent years, Schrödinger equations with nonlocal terms have attracted much attention. There are several nonlocal Schrödinger equations such as the Kirchhoff and the Schrödinger-Poisson system, and fractional order differential equations. Because of the nonlocal effect, the convergence and energy functional in a variational reduction are different from local ones. There have been papers studying fractional order differential equations; see [3–9]. When $b=0$, (1.1) is the Schrödinger-Poisson system. While $V_{2}=0$, (1.1) is the famous Kirchhoff equation. There has been interest in studying problem (1.1) with $b=0$ or $V_{2}=0$ under various assumptions on K and $V_{1}$ or $V_{2}$. For $b=0$, $K(x)=1$, the existence of positive solutions, ground state solutions, and multiple solutions for (1.1) has been massively addressed in the mathematical literature [10–14]. When $V_{2}=0$, there have been many papers to study the existence of positive solution and infinitely many solutions; see [15–20]. Especially, [16] studied the existence of nonnegative solutions to critical Kirchhoff problem. In addition, the systems with two types of nonlocal terms has been studied; see [8, 21]. In [8], fractional p-Kirchhoff equations was considered. The sign-changing solutions to Kirchhoff problems are also considered. For example, in [22–24], the authors proved the existence of sign-changing solutions for $b=0$, $V_{2}(x)=K(x)=1$. When $V_{2}=0$, [25] studied the existence of the least energy sign-changing solution to (1.1) with $V_{1}(x)=K(x)=1$. However, there have appeared few papers to study the case of $b\neq0$ and $V_{2}\neq0$; see [21]. In [21], the authors considered infinitely many solutions to (1.1).

Motivated by the above work, the main aim of this paper is to study the existence of a sign-change of (1.1) when the potentials $V_{1}$ and K decay to zero as $|x|\rightarrow\infty$. Precisely, we suppose:

(V):

$V_{1}:\mathbb{R}^{{N}}\rightarrow\mathbb{R}$ is a smooth function and there exist $a,c>0$ and $\tau\in(0,2)$ such that

$$ \frac{a}{1+|x|^{\tau}}\leq V_{1}(x)\leq c,\quad \forall x\in \mathbb{R}^{{N}}, $$

and $V_{2}\in L^{\infty}(\mathbb{R}^{N})\cup L^{(6-N)/2N}(\mathbb{R}^{N})$ is nonnegative;

(K):

$K:\mathbb{R}^{{N}}\rightarrow\mathbb{R}$ is a smooth function and there exist $\xi>\tau$, $d>0$ such that

$$ 0< K(x)\leq\frac{d}{1+|x|^{\xi}},\quad \forall x\in\mathbb{R}^{{N}}. $$

As regards the function f, we assume $f\in C(\mathbb{R},\mathbb {R})$ and we have the following hypotheses:

(f₁):

$f(t)=o(|t|)$ as $t\rightarrow0$;

(f₂):

$\lim_{t\rightarrow\infty}\frac {f(t)}{t^{3}}=+\infty$, where $F(t)=\int_{0}^{u}f(t)\, dt$;

(f₃):

there exists a $\theta\in[0,1)$ such that $\frac{K(x)f(t)-\theta V(x)t}{|t|^{3}}$ is nondecreasing on $(-\infty,0)$ and $(0,\infty)$, respectively;

(f₄):

$|f(t)|\leq C(|t|+|t|^{p})$, $p>3$.

The conditions (f₁)-(f₄) with $\theta=0$ are usual for the Kirchhoff equation or the Schrödinger-Poisson system; see [22, 25]. The condition (f₃) is equivalent to the one in [26, 27]

(V′):

$K(x)[\frac{f(\tau)}{\tau^{3}}-\frac{f(t\tau)}{(t\tau)^{3}}] \operatorname{sign}(1-t)+\theta V(x)\frac{|1-t^{2}|}{(t\tau)^{2}}\geq0$, $t>0$, $\tau\neq0$.

In fact, we have the next remark.

Remark 1.1

Condition (f₃) is equivalent to (V′).

Proof

We only prove the case of $t>0$. For $t\in(0,1]$, $t\tau \leq\tau$, then

$$\begin{aligned}& K(x)\biggl[\frac{f(\tau)}{\tau^{3}}-\frac{f(t\tau)}{(t\tau)^{3}}\biggr] \operatorname{sign}(1-t)+ \theta V(x)\frac{|1-t^{2}|}{(t\tau)^{2}} \\& \quad =K(x)\biggl[\frac{f(\tau)}{\tau^{3}}-\frac{f(t\tau)}{(t\tau)^{3}}\biggr] +\theta V(x) \frac{1-t^{2}}{(t\tau)^{2}} \\& \quad =\frac{K(x)f(\tau)-\theta V(x)\tau}{\tau^{3}}-\frac{K(x)f(t\tau )-\theta V(x)t\tau}{(t\tau)^{3}}. \end{aligned}$$

If $t>1$, then by $t\tau\geq\tau$, we have

$$\begin{aligned}& K(x)\biggl[\frac{f(\tau)}{\tau^{3}}+\frac{f(t\tau)}{(t\tau)^{3}}\biggr] \operatorname{sign}(1-t)+ \theta V(x)\frac{|1-t^{2}|}{(t\tau)^{2}} \\& \quad =-K(x)\biggl[\frac{f(\tau)}{\tau^{3}}+\frac{f(t\tau)}{(t\tau)^{3}}\biggr] -\theta V(x) \frac{1-t^{2}}{(t\tau)^{2}} \\& \quad =-\frac{K(x)f(\tau)-\theta V(x)\tau}{\tau^{3}}+\frac{K(x)f(t\tau )-\theta V(x)t\tau}{(t\tau)^{3}}. \end{aligned}$$

Therefore, the conclusion holds. □

In addition, we must notice that the condition on $V_{2}$ cannot ensure the nonlocal term $\phi_{u_{n}}\to\phi_{u}$ if $u_{n}\rightharpoonup u$ in $L^{2N/(N-2)}$. The least energy sign-changing solution to the Kirchhoff-Schrödinger-Poisson system has not been studied under the conditions (V) and (K). We unify the conditions $\theta=0$ and $\theta>0$ and generalize to the problem (1.1). Throughout this paper, we consider the weighted space $L_{K}^{q}$ of measurable $u:\mathbb{R}^{{N}}\rightarrow\mathbb{R}$ such that

$$ \vert u\vert _{q,K}:= \biggl[ \int_{\mathbb{R}}^{{N}}K(x)\bigl\vert u(x)\bigr\vert ^{q}\,dx \biggr]^{\frac {1}{q}}< \infty. $$

If K is a constant, $L^{p}_{K}$ is the usual space $L^{p}$ and the norm is denoted by $|\cdot|_{p}$. The weighted Sobolev spaces E defined by setting

$$ E= \biggl\{ u\in D^{1,2}\bigl(\mathbb{R}^{{N}}\bigr): \int_{\mathbb{R}}^{{N}}V_{1}(x)u^{2} \,dx < +\infty \biggr\} , $$

make E a Hilbert space with the inner product and the norm

$$ (u,v)= \int_{\mathbb{R}}^{{N}}\bigl(\nabla u\cdot\nabla v+V_{1}(x)uv\bigr)\,dx,\qquad \|u\| =(u,u)^{\frac{1}{2}}. $$

Then we have the following embedding theorem, which is often used later.

Proposition 1.2

[28]

Let $N\geq3$ and suppose that (V), (K) hold with $\tau\in(0,2]$ and $\xi>0$, respectively. Then, for $p\in[1,\frac{N+2}{N-2}]$, there is $C>0$ such that

$$ |u|_{p+1,K}\leq C\|u\|, \quad u\in E. $$

Furthermore, the embedding $E\hookrightarrow L_{K}^{p+1}$ is compact for $p\in(1,\frac{N+2}{N-2})$.

Let $g(x,t)=K(x)f(t)-\theta V(x)t$ and $G(x,t)=\int_{0}^{t} g(x,s)\,ds$, then we must notice the following fact.

Remark 1.3

If $u_{n}\rightharpoonup u$ in E, then $\int_{\mathbb{R}^{3}}KF(u_{n})\to\int_{\mathbb{R}^{3}}KF(u)$ and $\int _{\mathbb{R}^{3}}Kf(u_{n})u_{n}\to\int_{\mathbb{R}^{3}}Kf(u)u$, for the proof see Lemma 2.1. However, $G(x,t)$ and $g(x,t)$ do not satisfy these properties, due to the term $\int_{\mathbb {R}^{3}}V(x)u_{n}^{2}$. Therefore, we cannot replace $Kf(u)-\theta V(x)u$ with $g(x,u)$.

For every $u\in E$, the Lax-Milgram theorem implies that there exists a unique $\phi_{u}\in D^{1,2}(\mathbb{R}^{{N}})$, satisfying $-\Delta \phi_{u}=V_{2}u^{2}$. Thus, we can define the corresponding functional to (1.1) as follows:

$$\begin{aligned} J(u) :=&\frac{1}{2} \int_{\mathbb{R}^{{N}}}\bigl(|\nabla u|^{2}+V_{1}(x)u^{2} \bigr)+\frac{b}{4} \biggl( \int_{\mathbb{R}^{{N}}}|\nabla u|^{2} \biggr)^{2}+ \frac{1}{4} \int_{\mathbb{R}^{{N}}}V_{2}(x)\phi _{u}u^{2}- \int_{\mathbb{R}^{{N}}}KF(u) \\ =&\frac{1}{2}\|u\|^{2}+\frac{b}{4} \biggl( \int_{\mathbb{R}^{{N}}}|\nabla u|^{2} \biggr)^{2}+ \frac{1}{4} \int_{\mathbb{R}^{{N}}}V_{2}(x)\phi _{u}u^{2}- \int_{\mathbb{R}^{{N}}}KF(u). \end{aligned}$$

Here $G(x,u)=\int_{0}^{u}g(x,t)\,dt$. It is obvious that $J\in C^{1}(E,\mathbb{R})$ and

$$\begin{aligned} \bigl\langle J'(u),\varphi\bigr\rangle =& \int_{\mathbb{R}^{{N}}}\bigl(\nabla u\nabla\varphi+V_{1}(x)u \varphi\bigr)+b \int_{\mathbb{R}^{{N}}}|\nabla u|^{2} \int_{\mathbb{R}^{{N}}}\nabla u\cdot\nabla\varphi \\ &{}+ \int _{\mathbb{R}^{{N}}}V_{2}(x)\phi_{u}u\varphi- \int_{\mathbb {R}^{{N}}}Kf(u)\varphi \\ =&(u,\varphi)+b \int_{\mathbb{R}^{{N}}}|\nabla u|^{2} \int_{\mathbb {R}^{{N}}}\nabla u\cdot\nabla\varphi+ \int_{\mathbb{R}^{{N}}}V_{2}(x)\phi _{u}u\varphi- \int_{\mathbb{R}^{{N}}}K(x)f(u)\varphi. \end{aligned}$$

Clearly, critical points of J are the weak solutions to nonlocal problem (1.1). Furthermore, if $u\in E$ is a solution of (1.1) and $u^{\pm}\neq0$, then u is sign-changing, where

$$ u^{+}(x)=\max\bigl\{ u(x),0\bigr\} \quad \text{and} \quad u^{-}(x)=\min\bigl\{ u(x),0\bigr\} . $$

In order to get a least energy sign-changing solution for the system (1.1), we first try to seek a minimizer of the energy functional J with the following constraint:

$$ M:=\bigl\{ u\in E:u^{\pm}\neq0,\bigl\langle J'(u),u^{+}\bigr\rangle =\bigl\langle J'(u),u^{-}\bigr\rangle =0\bigr\} $$

(1.2)

and then we show that the minimizer is a sign-changing solution of (1.1). But in our problem (1.1), since f is not $C^{1}$, which is assumed in [22, 25], it is rather difficult to show that $M\neq\emptyset$. Thus, we must introduce some new ideas to get a sign-changing solution for the problem (1.1). In the present paper, we use a new homotopy operator which is $C^{1}$.

Now, we state our main theorem.

Theorem 1.4

If we have the assumptions (V), (K), and (f₁)-(f₄), then the problem (1.1) possesses at least one sign-changing solution which is the least energy sign-changing solution.

The paper is organized as follows. In Section 2, we prove several lemmas, which are crucial to prove our main results. In Section 3, we show that the minimizer of the constrained problem is a sign-changing solution by a new homotopy operator.

2 Preliminaries

Firstly, we give the convergence of the nonlinear term.

Lemma 2.1

Assume that $u_{n}\rightharpoonup u$ in E, then $\int_{\mathbb {R}^{{N}}}K(x)f(u_{n})u_{n}\rightarrow\int_{\mathbb{R}^{{N}}}K(x)f(u)u$ and $\int_{\mathbb{R}^{3}}K(x)F(u_{n})\to\int_{\mathbb{R}^{3}}K(x)F(u)$.

Proof

By Proposition 1.2, $u_{n}\to u$ strongly in $L^{q}_{K}$ for $q\in[2,6)$. Thus after passing to a subsequence, $u_{n}(x)\to u(x)$ for a.e. $x\in\mathbb{R}^{N}$. From the convergence of $u_{n}\to u$ in $L^{2}_{K}$ and $L^{p+1}_{K}$, there exist two functions $a\in L^{2}$ and $b\in L^{p+1}$ such that $K(x)u_{n}^{2}\leqslant a^{2}(x)$ and $K(x)|u_{n}|^{p+1}\leqslant[b(x)]^{p+1}$ for a.e. $x\in\mathbb{R}^{N}$. Therefore, (f₄) implies that

$$\begin{aligned} \biggl\vert \int_{\mathbb{R}^{N}}K(x)f(u_{n})u_{n}\biggr\vert & \leqslant \int_{\mathbb{R}^{N}}C\bigl\vert K(x)\bigr\vert u_{n}|^{2}+CK(x)|u_{n}|^{p+1} \\ &\leqslant \int_{\mathbb{R}^{N}}\bigl[C\bigl(a(x)\bigr)^{2}+C\bigl(b(x) \bigr)^{p+1}\bigr]\,dx. \end{aligned}$$

According to the dominated convergence theorem, $\int_{\mathbb {R}^{3}}K(x)f(u_{n})u_{n}\to\int_{\mathbb{R}^{3}}K(x)f(u)u$. A similar argument implies that $\int_{\mathbb{R}^{3}}K(x)F(u_{n})\to\int _{\mathbb{R}^{3}}K(x)F(u)$. The proof is completed. □

The next lemma shows that $M\neq\emptyset$.

Lemma 2.2

Assume that (f₁)-(f₄) hold. If $u\in E$ with $u^{\pm}\neq 0$, then there is a unique pair $(t,s)$ of positive numbers such that $tu^{+}+su^{-}\in M$.

Proof

Fix $u\in E$ with $u^{\pm}\neq0$, $\int_{\mathbb{R}^{N}}\nabla\phi _{u^{+}}\cdot\nabla\phi_{u^{-}}=\int_{\mathbb{R}^{N}}V_{2}(x)\phi _{u^{+}}(u^{-})^{2}$; since $-\Delta\phi_{u^{-}}=V_{2}(x)(u^{-})^{2}$, we can obtain

$$ \int_{\mathbb{R}^{N}}V_{2}(x)\phi_{u^{+}}\bigl|u^{-}\bigr|^{2} \,dx= \int_{\mathbb {R}^{N}}V_{2}(x)\phi_{u^{-}} \bigl|u^{+}\bigr|^{2}\,dx= \int_{\mathbb{R}^{N}}\nabla\phi_{u^{+}}\cdot\nabla \phi_{u^{-}}. $$

Denote $A:=b\int_{\mathbb{R}^{{N}}}|\nabla u^{+}|^{2}\,dx\int_{\mathbb {R}^{{N}}}|\nabla u^{-}|^{2}\,dx+\int_{\mathbb{R}^{{N}}}V_{2}(x)\phi _{u^{-}}|u^{+}|^{2}\,dx$ for convenience. We introduce the following notations:

$$\begin{aligned}& a_{1}=\bigl\Vert u^{+}\bigr\Vert ^{2}, \qquad a_{2}=b \biggl( \int_{\mathbb{R}^{N}}\bigl\vert \nabla u^{+}\bigr\vert ^{2} \biggr)^{2}; \end{aligned}$$

(2.1)

$$\begin{aligned}& b_{1}=\bigl\Vert u^{-}\bigr\Vert ^{2},\qquad b_{2}=b \biggl( \int_{\mathbb{R}^{N}}\bigl\vert \nabla u^{-}\bigr\vert ^{2} \biggr)^{2}. \end{aligned}$$

(2.2)

Since $-\Delta\phi_{u}=V_{2}(x)u^{2}=V_{2}(x)(u^{+})^{2}+V_{2}(x)(u^{-})^{2}=-\Delta (\phi_{u^{+}}+\phi_{u^{-}})$, $\phi_{u}=\phi_{u^{+}}+\phi_{u^{-}}$. Then, $tu^{+}+su^{-}$ is contained in M if and only if

$$ \left \{ \textstyle\begin{array}{l} g_{1}(t,s):=a_{1}t^{2}+a_{2}t^{4}+At^{2}s^{2}-\int_{\mathbb {R}^{{N}}}Kf(tu^{+})(tu^{+})=0, \\ g_{2}(t,s):=b_{1}s^{2}+b_{2}s^{4}+At^{2}s^{2}-\int_{\mathbb {R}^{{N}}}Kf(su^{-})(su^{-})=0. \end{array}\displaystyle \right . $$

(2.3)

We have from (f₁), (f₂), and (2.3) $g_{1}(t,t)>0$ and $g_{2}(t,t)>0$ for $t>0$ small and $g_{1}(s,s)<0$, $g_{2}(s,s)<0$ for $s>0$ large. Thus there exist $0<\delta<R$ such that

$$ g_{1}(\delta,\delta)>0, \qquad g_{1}(R,R)< 0; \qquad g_{2}(\delta,\delta )< 0,\qquad g_{2}(R,R)< 0. $$

(2.4)

From (2.3), it follows that $g_{1}(\delta,s)$, $g_{1}(R,s)$ both are increasing for $s\geq0$ and $g_{2}(t,R)$, $g_{2}(t,\delta)$ both are increasing for $t\geq0$. Therefore, by (2.4), we have

$$ g_{1}(\delta,s)>0, \qquad g_{1}(R,s)< 0, \quad s\in[\delta,R], $$

(2.5)

and

$$ g_{2}(t,\delta)>0, \qquad g_{2}(t,R)< 0, \quad t\in[\delta,R]. $$

(2.6)

By (2.5), (2.6), and Miranda’s theorem [29], there exists a point $(t_{u},s_{u})$ with $t_{u},s_{u}\in(\delta,R)$ such that $g_{1}(t_{u},s_{u})=g_{2}(t_{u},s_{u})=0$.

In the following, we prove the uniqueness of $(t,s)$. If there are two pairs $(t_{1},s_{1})$ and $(t_{2},s_{2})$ such that $t_{1}u^{+}+su^{-}\in M$ and $t_{2}u^{+}+su^{-}\in M$, then $(t_{1}/t_{2})t_{2}u^{+}+(s_{1}/s_{2})s_{2}u^{-}\in M$. Therefore, we may assume that $u\in M$ and $tu^{+}+su^{-}\in M$. We need only to prove that $t=s=1$. We assume that $0< t\leq s$. Then, by (2.3) and $\theta<1$, we have $b_{1}-\theta\int _{\mathbb{R}^{N}}V(x)(u^{-})^{2}>0$ and

$$ \biggl[b_{1}-\theta \int_{\mathbb{R}^{N}}V(x) \bigl(u^{-}\bigr)^{2}\biggr] \frac{1}{s^{2}}+b_{2}+A\geq \int_{\mathbb{R}^{N}}\frac{[Kf(su^{-})-\theta V(x)su^{-}]}{(su^{-})^{3}}\bigl(u^{-}\bigr)^{4}. $$

Since $u\in M$,

$$\begin{aligned}& \biggl[b_{1}-\theta \int_{\mathbb{R}^{N}}V(x) \bigl(u^{-}\bigr)^{2}\biggr] \biggl[ \frac{1}{s^{2}}-1 \biggr] \\& \quad \geq \int_{\mathbb{R}^{N}} \biggl\{ \frac{[Kf(su^{-})-\theta V(x)su^{-}]}{(su^{-})^{3}}-\frac{[Kf(u^{-})-\theta V(x)u^{-}]}{(u^{-})^{3}} \biggr\} \bigl(u^{-}\bigr)^{4}. \end{aligned}$$

According to condition (f₃), $s\leq1$. On the other hand, since $t\leq s$ and $u\in M$, similarly, we can obtain

$$\begin{aligned}& \biggl[a_{1}-\theta \int_{\mathbb{R}^{N}}V(x) \bigl(u^{+}\bigr)^{2}\biggr] \biggl[ \frac{1}{t^{2}}-1 \biggr] \\& \quad \leq \int_{\mathbb{R}^{N}} \biggl\{ \frac{[Kf(tu^{+})-\theta V(x)tu^{+}]}{(tu^{+})^{3}}-\frac{[Kf(u^{+})-\theta V(x)u^{+}]}{(u^{+})^{3}} \biggr\} \bigl(u^{+}\bigr)^{4}. \end{aligned}$$

Therefore, $t\geq1$. Consequently, $t=s=1$. □

Lemma 2.3

For $u\in E$ with $u^{\pm}\neq0$, the pair $(t_{u},s_{u})$ obtained in Lemma  2.2 is the maximum point of the function $\psi :\mathbb{R}_{+}\times\mathbb{R}_{+}\rightarrow\mathbb{R}$ defined as $\psi(t,s)=J(tu^{+}+su^{-})$, where $\mathbb{R}_{+}=[0,\infty)$.

Proof

From the proof of Lemma 2.2, $(t_{u},s_{u})$ is a critical point of ψ in $\mathbb{R}_{+}\times\mathbb{R}_{+}$. By assumptions (f₁), (f₂), and the proof of Lemma 2.2, we deduce that $J(tu^{+}+su^{-})>0$ for $t,s>0$ small and $\psi(t,s)\rightarrow -\infty$ as $|(t,s)|\rightarrow\infty$. Therefore, $(t_{u},s_{u})$ is the maximum point. In the following, we prove that $t_{u},s_{u}>0$. It is sufficient to check that a maximum point cannot be achieved on the boundary of $\mathbb{R}_{+}\times\mathbb{R}_{+}$. Without loss of generality, we may assume that $(0,s_{0})$ is a maximum point of ψ. Then, for $t>0$ small, by condition (f₁),

$$\begin{aligned} \psi(t,s_{0}) =&J\bigl(tu^{+}+s_{0}u^{-} \bigr) \\ =&\frac{t^{2}}{2}\bigl\Vert u^{+}\bigr\Vert ^{2}+ \frac{t^{4}}{4}b\bigl\vert \nabla u^{+}\bigr\vert ^{4}_{2}+ \frac {t^{4}}{4} \int_{\mathbb{R}^{{N}}}V_{2}(x)\phi_{u^{+}} \bigl(u^{+}\bigr)^{2}- \int _{\mathbb{R}^{{N}}}K(x)F\bigl(tu^{+}\bigr)\,dx \\ &{}+\frac{t^{2}s_{0}^{2}}{2}b\bigl\vert \nabla u^{+}\bigr\vert _{2}^{2} \bigl\vert \nabla u^{-}\bigr\vert ^{2}_{2}+ \frac{t^{2}s_{0}^{2}}{2} \int_{\mathbb{R}^{{N}}}V_{2}(x)\phi _{u^{+}} \bigl(u^{-}\bigr)^{2}\,dx \\ &{}+\frac{s_{0}^{2}}{2}\bigl\Vert u^{-}\bigr\Vert ^{2}+\frac{s_{0}^{4}}{4}b\bigl\vert \nabla u^{-}\bigr\vert _{2}^{4}+\frac{s_{0}^{4}}{4} \int_{\mathbb{R}^{{N}}}V_{2}(x)\phi _{u^{-}} \bigl(u^{-}\bigr)^{2}- \int_{\mathbb{R}^{{N}}}K(x)F\bigl(s_{0}u^{-}\bigr)\,dx \\ >&\frac{s_{0}^{2}}{2}\bigl\Vert u^{-}\bigr\Vert ^{2}+ \frac{s_{0}^{4}}{4}b\bigl\vert \nabla u^{-}\bigr\vert _{2}^{4}+ \frac{s_{0}^{4}}{4} \int_{\mathbb{R}^{{N}}}V_{2}(x)\phi _{u^{-}} \bigl(u^{-}\bigr)^{2}- \int_{\mathbb{R}^{{N}}}K(x)F\bigl(s_{0}u^{-}\bigr)\,dx \\ =&\psi(0,s_{0}). \end{aligned}$$

The pair $(0,s_{0})$ is not a maximum point of ψ in $\mathbb {R}_{+}\times\mathbb{R}_{+}$. □

Lemma 2.4

• (i) If $\langle J'(u),u^{\pm}\rangle<0$, then $(t_{u},s_{u})\in(0,1)^{2}$.

• (ii) If $u^{\pm}\ne0$ is such that $\langle J'(u),u^{\pm}\rangle \leqslant0$, then $(t_{u},s_{u})\in(0,1]^{2}$.

• (iii) If $\langle J'(u),u^{\pm}\rangle>0$, then $(t_{u},s_{u})\in(1,\infty)^{2}$.

Proof

Under the assumptions of (i), (ii), and (iii), we have $u^{\pm}\neq0$. Let $c_{1}=a_{1}-\theta \int_{\mathbb{R}^{N}}V(x)(u^{+})^{2}$ and $d_{1}=b_{1}-\theta\int_{\mathbb{R}^{N}}V(x)(u^{-})^{2}$, then $c_{1},d_{1}>0$. Since $t_{u}u^{+}+s_{u}u^{-}\in M$, we have from (2.3)

$$\begin{aligned} \bigl\langle J'(u),u^{+}\bigr\rangle =&c_{1} \biggl[1-\frac{1}{t^{2}_{u}} \biggr]+A \biggl[1-\frac{s^{2}_{u}}{t^{2}_{u}} \biggr] \\ &{}- \int_{\mathbb{R}^{N}} \biggl[\frac{K(x)f(u^{+})-\theta V(x)(u^{+})}{(u^{+})^{3}} -\frac{K(x)f(t_{u}u^{+})-\theta V(x)(t_{u}u^{+})}{(t_{u}u^{+})^{3}} \biggr] \bigl(u^{+}\bigr)^{4} \end{aligned}$$

(2.7)

and

$$\begin{aligned} \bigl\langle J'(u),u^{-}\bigr\rangle =&d_{1} \biggl[1-\frac{1}{s^{2}_{u}} \biggr]+A \biggl[1-\frac{t^{2}_{u}}{s^{2}_{u}} \biggr] \\ &{}- \int_{\mathbb{R}^{N}} \biggl[\frac{K(x)f(u^{-})-\theta V(x)(u^{-})}{(u^{-})^{3}} -\frac{K(x)f(s_{u}u^{-})-\theta V(x)(s_{u}u^{-})}{(s_{u}u^{-})^{3}} \biggr] \bigl(u^{-}\bigr)^{4}. \end{aligned}$$

(2.8)

For convenience, we introduce some notations as follows:

$$\begin{aligned}& D_{11}=c_{1} \biggl[1-\frac{1}{t^{2}_{u}} \biggr]+A \biggl[1- \frac {s^{2}_{u}}{t^{2}_{u}} \biggr], \\& D_{12}= \int_{\mathbb{R}^{N}} \biggl[\frac{K(x)f(u^{+})-\theta V(x)(u^{+})}{(u^{+})^{3}} -\frac{K(x)f(t_{u}u^{+})-\theta V(x)(t_{u}u^{+})}{(t_{u}u^{+})^{3}} \biggr] \bigl(u^{+}\bigr)^{4}, \\& D_{21}=d_{1} \biggl[1-\frac{1}{s^{2}_{u}} \biggr]+A \biggl[1- \frac {t^{2}_{u}}{s^{2}_{u}} \biggr], \\& D_{22}= \int_{\mathbb{R}^{N}} \biggl[\frac{K(x)f(u^{-})-\theta V(x)(u^{-})}{(u^{-})^{3}} -\frac{K(x)f(s_{u}u^{-})-\theta V(x)(s_{u}u^{-})}{(s_{u}u^{-})^{3}} \biggr] \bigl(u^{-}\bigr)^{4}. \end{aligned}$$

Without loss of generality, we may assume that $t_{u}\geqslant s_{u}$.

(i) If $t_{u}\geqslant1$, then $D_{11}\geqslant0$ and by the condition (f₃), we have $D_{12}\leqslant0$. It follows from (2.7) that $\langle J'(u),u^{+}\rangle\geqslant0$. This is a contradiction. Thus, $(t_{u},s_{u})\in(0,1)^{2}$.

(ii) If $t_{u}>1$, then $D_{11}>0$ and by the condition (f₃), we have $D_{12}\leqslant0$. Therefore, $\langle J'(u),u^{+}\rangle>0$. This is a contradiction. Thus, $(t_{u},s_{u})\in(0,1]^{2}$.

(iii) If $s_{u}\leqslant1$, similarly $D_{21}\leqslant0$ and $D_{22}\geqslant0$. It follows from (2.8) that $\langle J'(u),u^{-}\rangle\leqslant0$, which is a contradiction. Thus, $(t_{u},s_{u})\in(1,\infty)^{2}$. □

By Lemma 2.3, we may define the minimization problem

$$ m=\inf\bigl\{ J(u):u\in M\bigr\} . $$

(2.9)

Lemma 2.5

Suppose that conditions (f₁)-(f₄) hold, then $m>0$ can be achieved.

Proof

For any $u\in M$, we have $\langle J'(u),u\rangle=0$. Then we get from conditions (f₁) and (f₄)

$$\begin{aligned} \|u\|^{2}&\leq \int_{\mathbb{R}^{{N}}}\bigl(|\nabla u|^{2}+V_{1}(x)u^{2}+V_{2}(x) \phi_{u}u^{2}\bigr)\,dx+b|\nabla u|_{2}^{4} \\ &= \int_{\mathbb{R}^{{N}}}K(x)f(u)u \\ &\leq\varepsilon \int_{\mathbb{R}^{N}} K(x)u^{2}+C_{\varepsilon} \int _{\mathbb{R}^{N}} K(x)u^{p+1}. \end{aligned}$$

Then by Proposition 1.2, we can get

$$ \|u\|^{2}\leq C_{1}\varepsilon\|u\|^{2}+C_{2} \|u\|^{p+1}, $$

where $C_{1}, C_{2}>0$ are constants. So there exists a constant $\alpha>0$ such that $\|u\|\geq\alpha$. Moreover, by (f₃), we have

$$ \bigl[K(x)f(t)t-\theta V(x)t^{2}\bigr]-4\biggl[K(x)F(t)-\theta \frac{1}{2}V(x)t^{2}\biggr]\geq0,\quad x\in\mathbb{R}^{N},t \in\mathbb{R}. $$

Hence, we have

$$\begin{aligned} J(u) =&J(u)-\frac{1}{4}\bigl\langle J'(u),u\bigr\rangle \\ =&\frac{1}{4}\|u\|^{2}+\frac{1}{4} \int_{\mathbb {R}^{{N}}}K(x) \bigl(f(u)u-4F(u)\bigr) \\ \geq&\frac{1}{4}\|u\|^{2}-\frac{1}{4}\theta \int_{\mathbb{R}^{N}}V(x)u^{2} \\ \geq&\frac{1}{4}(1-\theta)\alpha^{2}. \end{aligned}$$

This implies that $m\geq\frac{1}{4}(1-\theta)\alpha^{2}>0$.

Let $\{u_{n}\}\subset M$ be such that $J(u_{n})\rightarrow m$. Then $\{ u_{n}\}$ is bounded in E, so there exists a subsequence of $\{u_{n}\}$ and $u\in E$, we may still denote the subsequence by $\{u_{n}\}$, such that $u_{n}\rightharpoonup u$ and $u_{n}^{\pm}\rightharpoonup u^{\pm}$ weakly in E and $u_{n}(x)\to u(x)$ a.e. $x\in\mathbb{R}^{N}$. Since $\{ u_{n}\}\in M$, we have $\langle J'(u_{n}),u_{n}^{+}\rangle=0$. That is,

$$ \bigl\Vert u_{n}^{+}\bigr\Vert ^{2}+b\vert \nabla u_{n}\vert ^{2}_{2} \bigl\vert \nabla u_{n}^{+}\bigr\vert _{2}^{2}+ \int_{\mathbb {R}^{{N}}}V_{2}(x)\phi_{u_{n}} \bigl(u_{n}^{+}\bigr)^{2}= \int_{\mathbb {R}^{{N}}}Kf\bigl(u_{n}^{+} \bigr)u_{n}^{+}. $$

(2.10)

This implies from conditions (f₁) and (f₄) that there exists a constant $\rho>0$ such that $\|u_{n}^{+}\|\geq\rho$ for all $n\in \mathbb{N}$. By (2.10) and Lemma 2.2, we get

$$ 0< \rho^{2}\leq\bigl\Vert u_{n}^{+}\bigr\Vert ^{2}\leq \int_{\mathbb {R}^{{N}}}Kf\bigl(u_{n}^{+} \bigr)u_{n}^{+}= \int_{\mathbb{R}^{{N}}}Kf\bigl(u^{+}\bigr)u^{+}+o(1), $$

where $o(1)$ denotes a quantity tending to zero as $n\rightarrow +\infty$. Thus, $u^{+}\neq0$. Similarly, we have $u^{-}\neq0$.

Since $u_{n}\rightharpoonup u$ in E, we have $\phi _{u_{n}}\rightharpoonup\phi_{u}$ in $D^{1,2}(\mathbb{R}^{{N}})$ if $V_{2}\in L^{\infty}(\mathbb{R}^{N})$ or $\phi_{u_{n}}\to\phi_{u}$ in $D^{1,2}(\mathbb{R}^{{N}})$ if $V_{2}\in L^{(6-N)/2N}(\mathbb{R}^{N})$. By the weak lower semicontinuity of the norm and Fatou’s lemma, we have

$$\begin{aligned}& \bigl\Vert u^{+}\bigr\Vert ^{2}+b\vert \nabla u \vert ^{2}_{2}\bigl\vert \nabla u^{+}\bigr\vert _{2}^{2}+ \int_{\mathbb {R}^{{N}}}V_{2}(x)\phi_{u}\bigl\vert u^{+}\bigr\vert ^{2}\,dx \\& \quad \leq \liminf_{n\rightarrow+\infty}\biggl(\bigl\Vert u_{n}^{+}\bigr\Vert ^{2}+b\vert \nabla u_{n}\vert ^{2}_{2}\bigl\vert \nabla u_{n}^{-}\bigr\vert ^{2}_{2}+ \int_{\mathbb {R}^{{N}}}V_{2}(x)\phi_{u_{n}}\bigl\vert u_{n}^{+}\bigr\vert ^{2}\,dx\biggr). \end{aligned}$$

Then from (2.10) and Lemma 2.1 we get

$$ \bigl\Vert u^{+}\bigr\Vert ^{2}+b\vert \nabla u\vert ^{2}_{2}\bigl\vert \nabla u^{+}\bigr\vert _{2}^{2}+ \int_{\mathbb {R}^{{N}}}V_{2}(x)\phi_{u}\bigl\vert u^{+}\bigr\vert ^{2}\,dx\leq \int_{\mathbb{R}^{{N}}}Kf\bigl(u^{+}\bigr)u^{+}. $$

(2.11)

Similarly, we have

$$ \bigl\Vert u^{-}\bigr\Vert ^{2}+b\vert \nabla u\vert _{2}^{2}\bigl\vert \nabla u^{-}\bigr\vert _{2}^{2}+ \int_{\mathbb {R}^{{N}}}V_{2}(x)\phi_{u}\bigl\vert u^{-}\bigr\vert ^{2}\,dx\leq \int_{\mathbb{R}^{{N}}}Kf\bigl(u^{-}\bigr)u^{-}. $$

(2.12)

From (2.11), (2.12), and the proof of Lemma 2.4, there exists $(\overline{t},\overline{s})\in(0,1]\times (0,1]$ such that $\overline{u}=\overline{t}u^{+}+\overline {s}u^{-}\in M$. Moreover, according to condition (f₃) we have $[K(x)f(t)t-\theta V(x)t^{2}]-4[K(x)F(t)-\frac{1}{2}\theta V(x)t^{2}]\geq0$ is nondecreasing on $(-\infty,0)$ and $(0,\infty)$, respectively. Thus,

$$\begin{aligned} m&\leq J(\overline{u})=J(\overline{u})-\frac{1}{4}\bigl\langle J'(\overline{u}),\overline{u}\bigr\rangle \\ &=\frac{1}{4}\|\overline{u}\|^{2}+\frac{1}{4} \int_{\mathbb {R}^{{N}}}K\bigl(f(\overline{u})\overline{u}-4F(\overline{u}) \bigr)\,dx \\ &=\frac{1}{4}\bigl(\bigl\| \overline{t}u^{+}\bigr\| ^{2}+\bigl\| \overline{s}u^{-}\bigr\| ^{2}\bigr)+\frac{1}{4} \int_{\mathbb{R}^{{N}}}K\bigl(f(\overline{u})\overline {u}-4F(\overline{u}) \bigr)\,dx \\ &\leq\frac{1}{4}|\nabla u|_{2}^{2}+\frac{1}{4} \int_{\mathbb {R}^{N}}V(x)\overline{u}^{2}+\frac{1}{4} \int_{\mathbb {R}^{{N}}}K\bigl(f(u)u-4F(u)\bigr)\,dx+\frac{1}{4}\theta \int_{\mathbb {R}^{N}}V(x)\bigl[u^{2}-\overline{u}^{2} \bigr] \\ &\leq\frac{1}{4}|\nabla u|_{2}^{2}+ \frac{1}{4}(1-\theta) \int_{\mathbb {R}^{N}}V(x)u^{2}+\frac{1}{4} \int_{\mathbb{R}^{{N}}}\bigl[K\bigl(f(u)u-4F(u)\bigr)+\theta V(x)u^{2}\bigr] \\ &\leq \liminf_{n\to\infty} \biggl[J(u_{n})-\frac {1}{4} \bigl\langle J'(u_{n}),u_{n}\bigr\rangle \biggr]=m. \end{aligned}$$

By the above inequality and Lemma 2.3 we deduce that $\overline{t}=\overline{s}=1$. Thus $\overline{u}=u$ and $J(u)=m$. □

3 Existence of sign-changing solution

In this section, we mainly prove that the minimizer u obtained in Lemma 2.5 is indeed a sign-changing solution of (1.1), that is, $J'(u)=0$.

Proof of Theorem 1.4

Using the quantitative deformation lemma [30], Lemma 2.3, we prove that $J'(u)=0$. It is clear that $\langle J'(u),u^{+}\rangle=\langle J'(u),u^{-}\rangle=0$. It follows from Lemma 2.3 that, for $(t,s)\in\mathbb{R}_{+}\times\mathbb{R}_{+}$ and $(t,s)\neq(1,1)$,

$$ J\bigl(tu^{+}+su^{-}\bigr)< J \bigl(u^{+}+u^{-}\bigr)=m. $$

(3.1)

If $J'(u)\neq0$, then there exist $\delta>0$ small and $\varepsilon_{0}>0$ such that, for all $\|v-u\|\leq3\delta$,

$$ \bigl\Vert J'(v)\bigr\Vert \geq\varepsilon_{0}. $$

Let $D:=(1-\delta/\|u\|,1+\delta/\|u\|)\times(1-\delta/\|u\| ,1+\delta/\|u\|)$ and $h(t,s)=tu^{+}+su^{-}$. It follows from Lemma 2.3 again that

$$ \overline{m}:= \max_{\partial D}J\circ h< m. $$

(3.2)

By [30], Lemma 2.3, for $\varepsilon:=\min\{(m-\overline {m})/2,\varepsilon_{0}\delta/8\}$ and $S:=B(u,\delta)$, there is a deformation η such that

• (a) $\eta(1,u)=u$ if $u\notin J^{-1}([m-2\varepsilon ,m+2\varepsilon])\cap S_{2\delta}$;

• (b) $\eta(1,J^{m+\varepsilon}\cap S)\subset J^{m-\varepsilon}$;

• (c) $J (\eta(1,u) )\leq J(u)$ for all $u\in E$.

For $(t,s)\in\overline{D}$, $\|h(t,s)-u\|^{2}=(t-1)^{2}\|u^{+}\|^{2}+(s-1)^{2}\| u^{-}\|^{2}\leq\delta^{2}$, then $h(t,s)\in S$ for all $(t,s)\in\overline {D}$. On the other hand, $\max_{\overline{D}}J(h(t,s))=m$, therefore, from (b) we have

$$ \max_{(t,s)\in\overline{D}}J\bigl(\eta\bigl(1,h(t,s)\bigr) \bigr)< m. $$

(3.3)

We prove that $\eta(1,h(D))\cap M\neq\emptyset$, contradicting the definition of m. Let us define $\gamma(t,s):=\eta(1,h(t,s))$ and

$$\begin{aligned}& \Psi _{0}(t,s):=\bigl(J'\bigl(h(t,s) \bigr)u^{+},J'\bigl(h(t,s)\bigr)u^{-}\bigr)= \bigl(J'\bigl(tu^{+}+su^{-} \bigr)u^{+},J'\bigl(tu^{+} +su^{-} \bigr)u^{-}\bigr), \\& \Psi_{1}(t,s):=\biggl(\frac{1}{t}J'\bigl( \gamma(t,s)\bigr)\gamma^{+}(t,s),\frac {1}{s}J' \bigl(\gamma(t,s)\bigr)\gamma^{-}(t,s)\biggr). \end{aligned}$$

Since $f:\mathbb{R}\to\mathbb{R}$ is continuous, $\Psi_{0}:\overline {D}\to\mathbb{R}^{2}$ is continuous. Then we cannot directly compute the topology degree $\operatorname{deg}(\Psi_{0},D,0)$. Now, we define the operator as follows: $\Phi(t,s):=(\phi_{1}(t,s),\phi_{2}(t,s))$ where

$$ \left \{ \textstyle\begin{array}{l} \phi_{1}(t,s)=-a_{1}t^{2}(t^{2}-1), \\ \phi_{2}(t,s)=-b_{1}s^{2}(s^{2}-1). \end{array}\displaystyle \right . $$

Then Φ has unique zero $(t,s)=(1,1)$. Let us take a homotopy operator

$$ H\bigl(\tau,(t,s)\bigr)=\tau\Psi_{0}+(1-\tau)\Phi. $$

It is easy to see that $H(\tau,(1,1))=0$. Then $H(1,(t,s))=\Psi_{0}(t,s)$ and $H(0,(t,s))=\Phi(t,s)$. Moreover, $H:[0,1]\times\overline{D}$ is continuous. We will show that $H(\tau ,(t,s))\neq0$ on $[0,1]\times\partial D$. In fact, if $\tau=1$, according to Lemma 2.2 we see that $(1,1)$ is the unique zero point of $H(0,(t,s))$. If $\tau=0$, from the definition of Φ, the conclusion is obvious. In the following, we may assume that $\tau\in(0,1)$. It is easy to see that for any $\tau\in(0,1)$, $(1,1)$ is a zero point of $H(\tau,(t,s))$. Therefore, we need only to prove that the zero point of $H(\tau ,(t,s))$ is unique in D̅. If $(t_{0},s_{0})\in\overline{D}$ is a zero point of $H(\tau,(t,s))$, that is,

$$\begin{aligned}& a_{1}\tau t_{0}^{2}+a_{1}(1- \tau)t_{0}^{2}\bigl(1-t_{0}^{2}\bigr)+ \tau a_{2}t_{0}^{4}+\tau At_{0}^{2}s_{0}^{2} \\& \quad {}- \tau \int_{\mathbb{R}^{{N}}}\bigl[Kf\bigl(t_{0}u^{+}\bigr) \bigl(t_{0}u^{+}\bigr)-\theta V(x)\bigl\vert t_{0}u^{+}\bigr\vert ^{2}\bigr]=0 \end{aligned}$$

(3.4)

and

$$\begin{aligned}& b_{1}\tau s_{0}^{2}+b_{1}(1- \tau)s_{0}^{2}\bigl(1-s_{0}^{2} \bigr)+b_{2}\tau s_{0}^{4}+A\tau t_{0}^{2}s_{0}^{2} \\& \quad {}- \tau \int_{\mathbb{R}^{{N}}}\bigl[Kf\bigl(s_{0}u^{-}\bigr) \bigl(s_{0}u^{-}\bigr)-\theta V(x)\bigl\vert s_{0}u^{-}\bigr\vert ^{2}\bigr]=0. \end{aligned}$$

(3.5)

We may assume that $t_{0}\leq s_{0}$. Then from (3.5), we have

$$ b_{1} \biggl[\frac{\tau}{s_{0}^{2}}-\frac{(1-\tau)(s_{0}^{2}-1)}{s_{0}^{2}} \biggr]+b_{2}\tau+A\tau\geq\tau \int_{\mathbb{R}^{{N}}} \frac{Kf(s_{0}u^{-})-\theta s_{0} V(x)(u^{-})^{2}}{s_{0}^{3}(u^{-})^{3}}\bigl(u^{-}\bigr)^{4}. $$

On the other hand, it follows from $u\in M$ that

$$ b_{1}+b_{2}+A= \int_{\mathbb{R}^{3}}\bigl[Kf\bigl(u^{-}\bigr)u^{-}-\theta V(x) \bigl(u^{-} \bigr)^{2}\bigr]. $$

Therefore,

$$\begin{aligned} b_{1} \biggl[\frac{1}{s_{0}^{2}}-1 \biggr]&=b_{1} \biggl[ \frac{\tau}{s_{0}^{2}}-\frac {(1-\tau)(s_{0}^{2}-1)}{s_{0}^{2}}-\tau \biggr] \\ &\geq\tau \int_{\mathbb{R}^{{N}}} \biggl\{ \frac{Kf(s_{0}u^{-})-\theta s_{0} V(x)(u^{-})^{2}}{s_{0}^{3}(u^{-})^{3}}\bigl(u^{-} \bigr)^{4}-\bigl[Kf\bigl(u^{-}\bigr)u^{-}-\theta V(x) \bigl(u^{-} \bigr)^{2}\bigr] \biggr\} . \end{aligned}$$

Hence, we have from the condition (f₃) that $s_{0}\leq1$. In the following, we prove that $t_{0}\geq1$. In fact from (3.4) and $0< t_{0}\leq s_{0}$, we have

$$ a_{1} \biggl[\frac{\tau}{t_{0}^{2}}-\frac{(1-\tau)(t_{0}^{2}-1)}{t_{0}^{2}} \biggr]+a_{2}\tau+A\tau\leq\tau \int_{\mathbb{R}^{{N}}}\frac {Kf(t_{0}u^{+})-\theta V(x)t_{0}u^{+}}{t_{0}^{3}(u^{+})^{3}}\bigl(u^{+}\bigr)^{4}. $$

(3.6)

Since $u\in M$, we have from (3.6)

$$\begin{aligned} a_{1} \biggl[\frac{1}{t_{0}^{2}}-1 \biggr]&=a_{1} \biggl[\frac{\tau}{t_{0}^{2}}-\frac {(1-\tau)(t_{0}^{2}-1)}{t_{0}^{2}}-\tau \biggr] \\ &\leq\tau \int_{\mathbb{R}^{{N}}}\frac{Kf(t_{0}u^{+})-\theta V(x)t_{0}u^{+}}{t_{0}^{3}(u^{+})^{3}}\bigl(u^{+}\bigr)^{4}- \bigl[Kf\bigl(u^{+}\bigr)u^{+}-\theta V(x) \bigl(u^{+}\bigr)^{2}\bigr]. \end{aligned}$$

(3.7)

Therefore, condition (f₃) implies that $t_{0}\geq1$ and then $s_{0}=t_{0}=1$. Hence for $(s,t)\in\partial D$, we obtain $H(\tau,(t,s))\neq0$ for all $\tau\in[0,1]$. Therefore, the homotopy invariance property of Brouwer’s degree implies that $\operatorname{deg}(H(\tau,(\cdot,\cdot )),D,0)=\mathrm{constant}$ for $\tau\in[0,1]$ and then

$$ \operatorname{deg}(\Psi_{0},D,0)=\operatorname{deg}\bigl(H\bigl(1,( \cdot,\cdot)\bigr),D,0\bigr)=\operatorname{deg}\bigl(H\bigl(0,(\cdot,\cdot ) \bigr),D,0\bigr)=\operatorname{deg}(\Phi,D,0). $$

Hence, we need only to compute $\operatorname{deg}(\Phi,D,0)$. Note that $\Phi\in C^{1}$, and Φ has an isolated zero point $(1,1)$ in D. Since

$$\begin{aligned}& \frac{\partial\phi_{1}}{\partial t}(1,1)=-2a_{1},\qquad \frac{\partial \phi_{1}}{\partial s}(1,1)=0, \\& \frac{\partial\phi_{2}}{\partial t}(1,1)=0,\qquad \frac{\partial\phi _{2}}{\partial s}(1,1)=-2b_{1}, \end{aligned}$$

we have

$$ \left \vert \textstyle\begin{array}{@{}c@{\quad}c@{}} -2a_{1} & 0\\ 0& -2b_{1} \end{array}\displaystyle \right \vert =4a_{1}b_{1}>0. $$

Then according to the definition of the topological degree, we have

$$ \operatorname{deg}(\Phi,D,0)=1. $$

On the other hand, it follows from (3.2) that $h=\gamma$ on ∂D. Consequently, we obtain $\operatorname{deg}(\Psi_{1},D,0)=\operatorname{deg}(\Psi _{0},D,0)=1$ from the property of the topological degree. Therefore, $\Psi_{1}(t_{0},s_{0})=0$ for some $(t_{0},s_{0})\in D$, that is, $\eta(1,h(t_{0},s_{0}))=\gamma(t_{0},s_{0})\in M$, which is a contradiction with $\eta(1,h(D))\cap M\neq\emptyset$. From this, u is a critical point of J, and then it is a sign-changing solution for problem (1.1). □